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FOREWORD 


authors were in the final year of a three-year term as 

postdoctoral fellows in behavior science at the Insti- 
tute of Human Relations of Yale University. The main pur- 
pose of the fellowship program was to provide opportunity 
for training, teaching, and research in some of the better inte- 
grated parts of behavioral science and to explore the possibili- 
ties of wider integration. Recorded in this volume are some of 
the results of the explorations of this group. 

It is a book about problems—containing no new data, it is 
published as a contribution to behavior theory. In a sense it is 
a tribute to the late Clark L. Hull, whose theory has been 
chosen as the starting point from which analyses of some of 
the problems have proceeded. In the last decade of his life 
Professor Hull had entertained the hope and belief that his 
theory could be extended to encompass a wide range of data 
from several social sciences. He realized that this would be a 
long and tedious task and that his theory might well undergo 
drastic revision before it could predict more complex forms of 
human behavior. Some of the points at which revisions now 
seem indicated are discussed here. 

Other problems taken up in this volume stem not specifically 
from Hullian theory but from a wider stimulus-response point 
of view. All theories that view behavior from the standpoint 
of input-output or antecedent conditions—behavioral conse- 
quences are confronted with common problems such as choice 
of intervening variables and their operational definitions. 
Omitted from consideration are all nonstimulus-response 
types of behavior theory, including psychoanalysis, whose ab- 
sence may be conspicuous to readers familiar with publications 
from the Institute of Human Relations. This omission, like 
Some others, is due to lack of time for thorough study and 
critical analysis. 

The postdoctoral fellowship appointments of the authors 

vil 
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were financed by a grant to Yale from the Ford Foundation in 
the autumn of 1950. 


Marx A. May 
New Haven, Connecticut 


May 10, 1954 


PREFACE 


REPARATION of this volume was a terminal- 
year project of the authors’ three years of close asso- 
ciation while Ford fellows in behavior science at the 

Institute of Human Relations of Yale University. We wish to 
thank the Ford Foundation, Yale University, and, in particu- 
lar, Mark A. May, Director of the Institute, for making these 
opportunities available to us. 

During our tenure as fellows, much was given and nothing 
demanded of us. Meeting throughout the first year, five days 
a week for several hours a day, we had a chance to teach one 
another portions of our various fields. We also had oppor- 
tunity to attend, sometimes as a group, sometimes individ- 
ually, courses or seminars in clinical psychiatry, mathematics, 
law, chemistry, symbolic logic, perception, learning theory, 
and sociology. During the last two years each of us has de- 
voted part of his time to teaching in our respective depart- 
ments. 

In accordance with the interdisciplinary traditions of the 
Institute of Human Relations, senior colleagues gave gen- 
erously of their time when asked to sit in on our sessions dur- 
ing the discussion of matters within their special competence. 
We gratefully acknowledge our intellectual debt to John Dol- 
lard, Clellan S. Ford, Clark L. Hull, Ralph Linton, Neal E. 
Miller, George Peter Murdock, Frederick C. Redlich, and 
Fred L. Strodtbeck, each of whom talked with the group on 
one or more occasions. 

Of course, our indebtedness is by no means limited to those 
who had oceasion to attend our sessions. We have profited 
from discussion with our colleagues Chris Argyris, E. Wight 
Bakke, Frank A. Beach, Wendell C. Bennett, Bernard Bloch, 
Claude Buxton, Leonard Doob, Isidore Dyen, John S. Ells- 
worth, Jr., A. B. Hollingshead, Carl I. Hovland, Friedrich 
Kessler, Floyd Lounsbury, Sidney W. Mintz, Rulon S. Wells, 
IH, and Albert F. Wessen. Since it would be quite imprac- 
ticable to attempt to indicate all those who have been of help 
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to us in one way or another, the above enumeration must be 
viewed as but a partial one. 

We are especially indebted to Mark A. May. He attended 
most of our sessions, and his wide knowledge of several fields 
in social science was always at our disposal. Determined not 
to dictate any course of action, he was ever ready to advise 
when asked. His knowledge of the pitfalls in interdisciplinary 
research guided us around a number of such difficulties, and 
his fruitful contributions to our discussions make him, in a 
real sense, one of the collaborators in this volume. 

Our gratitude is also due Jane Brown, G. Sarah Greer, 
Ruth Hays, and Elizabeth Pulley. Mrs. Pulley typed an 
earlier draft of the volume, and Mrs. Brown has typed a num- 
ber of succeeding drafts, including the final one. Miss Hays 
has read the entire manuscript and suggested many felicitous 
changes. Miss Greer, Executive Secretary of the Institute of 
Human Relations, has smoothed our path in numerous ways 
during our tenure of the fellowships. 

Finally, we wish to state that not all 
completely endorsed by all five authors. We have had, and still 
have, diverse opinions on several major issues. Rather than 
insert minority dissents at such points, we have attempted to 
represent our different views within the text. Despite these 


divergences, we are gratified at the extent to which we have 
been able to attain consensus. 


parts of this book are 


F.A.L., D.1L..0., BS. Ra; R.D.S., C.M.S. 
New H aven, Connecticut 


May 1954 


CHAPTER 1 


INTRODUCTION 


E share with many social scientists the belief that 
each discipline concerned with human behavior can 
i profit by utilizing materials drawn from other so- 
cial sciences. Many attempts at interdisciplinary cooperation 
have been made in investigations of specific problems. An- 
other approach to integration of the social sciences entails 
exploration of methodological and theoretical barriers ham- 
pering the development of a comprehensive analysis of hu- 
man behavior. This book summarizes such an exploration by 
representatives of anthropology, economics, linguistics, psy- 
chology, and sociology. 

We have concentrated our attention on the prospects of 
using modern psychological principles of individual be- 
havior in predicting human social phenomena. This required 
examining some general issues which confront any attempt 
to formulate propositions about human behavior in stimulus- 
response terms. Such propositions range from empirical gen- 
eralizations to highly theoretical statements. We began with 
a stimulus-response framework because it provided a least 
common denominator. This framework admittedly is not 
the only one which can be used, and we are not entirely con- 
vinced that it is the most fruitful one available. Nevertheless 
it has proved a useful basis for our inquiry. 

Along with our discussion of general stimulus-response 
theory, we have examined the particular S-R behavior sys- 
tem proposed by Clark L. Hull and his colleagues. Here we 
have considered some problems which would arise in using 
Hull’s reinforcement theory as a major analytical tool for 
studying human social behavior. Our first step was to review 
the way in which this theory handles the experimental data 
on which it was originally based. We have not made an ex- 
tensive critique of Hull’s theory from the point of view of 
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experimental psychology since our primary interest was to 
anticipate future difficulties in applying his theory to more 
complex events. We then explored possibilities of such gen- 
eralization. 

We had several different reasons for devoting so much 
attention to Hull’s theory and its derivatives. Since this 
theory is an extensive attempt at a comprehensive account 
of behavior, it deserves study on its own merits. Moreover, an 
extension of Hull’s theory to a wide range of data from sev- 


eral social sciences has suggested some important issues for 


the development of any stimulus-response analysis of human 
behavior. Finally, furthe 


r study of those issues has in turn 
clarified some of the difficulties faced by Hull’s theory. 

eliberately limited in scope. First of 
proposing a new comprehensive the- 
d our ability at present to develop a 
specific, testable predictions about a 


1. This use was not an 
theorems abo; 
adaptation o 


ut cultural Plenoan of Hullin theory to generate predictive 
f an empirical generalization derer of appropriation and 


oped by another science, 
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adequate knowledge of both borrowing and lending theories, 
can have a salutary result. Nothing, however, could be more 
destructive of the aims of integration than the taking over 
of mere phrases by superficial analogy without due regard for 
their original definitions or proper theoretical consequences 
(Olmsted, 1953; Moore and Olmsted, 1952; Olmsted and 
Moore, 1952). 

_ With this orientation, our book proceeds along the follow- 
ing lines: In the remainder of this chapter we briefly state our 
view of theory construction and its relation to integration in 
the social sciences. In Chapter 2 we outline the major charac- 
teristics of Hull’s theory. Rather than give an extensive ex- 
position of this theory, we state only those concepts and 
propositions which are necessary for the remainder of the 
present work. Since any stimulus-response analysis requires 
a reliable way of defining, classifying, and measuring re- 
sponses, we examine in Chapter 3 the several different meth- 
ods of doing this which have been used in the social sciences. 
In the fourth chapter we consider several stimulus conditions 
which experimental psychology has found to be important 
determinants of individual behavior. Then, in the last four 
chapters, we discuss some specific problems involved in mak- 
ing a stimulus-response analysis of human behavior and, 
wherever possible, indicate some research which we believe 
would be valuable in solving such problems. Chapter 5 is de- 
voted to language; Chapter 6 concerns what we shall call 
free behavior situations ; and Chapter 7 discusses social inter- 
action. Finally, in Chapter 8, we consider some areas in social 
Science to which stimulus-response theories are most likely to 
Prove applicable. 


Some Aspects or THEORY CONSTRUCTION 


_ Since this essay is concerned with theoretical integration, 
it will perhaps be helpful, if only for pedagogical purposes, 
for us to state at the outset our understanding of the terms 
“theory” and “integration” and their interrelations. 

Since we accept successful prediction (Spence, 1944, pp. 
47-8) as a goal of behavior science, questions about theory 
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may be approached in terms of the relevance of theory to such 
prediction. Prediction, which consists in statements concern- 
ing some future state of affairs, by its very nature involves 
assumptions as to at least the partial nonuniqueness of phe- 
nomena. He who would predict must therefore make some 
judgment, somewhere along the way, that some phenomena 
are the same or partially the same and that others are not; 
ie. he must classify. Most adult human beings possess a 
ready-made mechanism for making such judgments, namely 
a natural language. By talking about things we classify them, 
whether we recognize the fact or not. This is a fact of some 
importance, since we are entitled to ask if any given set of 
statements, whether it be of a ready-made “folksy” variety 
or any other, is an efficient implement in the work of predict- 
ing. 

The term “theory” has been defined and interpreted in 
many different ways. Everyone agrees that a theory is, among 
other things, a set of statements ; there is disagreement about 
what other characteristics any set of statements must have 
in order to be labeled “theory.” In what follows, we outline 
our view of these additional characteristics. 

The ultimate test of any theory is the extent to which the 
predictions resulting from it are confirmed. To minimize 
disagreement as to what predictions legitimately result from 
a given theory, certain ground rules have been adopted. 
These ground rules include the principles of logic and mathe- 


matics, and help reduce ambiguities by the partial restric- 
tion of natural 1 


anguage. Their introduction follows from 
the application of a still more basic convention, namely that 
scientific activity should be replicable by other investigators. 
An ambiguous term can be as injurious to replicability as 
an undescribed piece of apparatus. Another value of the 
ground rules is the additional analytical power they often 
provide; e.g. 1 economics the rules of mathematics permit 
deduction from maximization postulates of many meaningful 
restrictions on price-quantity data. 
_ Those statements of a theory used as premises in the deduc- 
tive process are its postulates, Some of these may be directly 
testable; some may not. The postulates may be based on data, 
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and these data may come from the theorist’s own field or 
from other fields. The rules of deduction drawn from mathe- 
matics and logic also have the status of postulates, although 
they are not generally stated in ewtenso in theories. Those 
things taken as given, plus the rules of deduction, are then 
its postulates. The logical consequences of the postulates are 
theorems. Ideally, the postulates should be “(1) as few as 
possible, (2) consistent with each other, and (3) sufficient 
to mediate the deduction [of] theorems” that correspond, 
operationally, to all relevant data (Hull et al., 1940). Theo- 
ries that attempt to predict natural phenomena generally fall 
short of this ideal. 

In viewing a theory as a set of statements we made no com- 
mitment as to whether the statements are made up of mor- 
phemes from a natural language or of items from the 
restricted languages of symbolic logic and mathematics 
(Samuelson, 1947, pp. 23ff.; Arrow, 1951, pp. 129-54). As 
a matter of fact, as we have seen, the natural language of 
some investigators is used unintentionally for this purpose. 

owever, serious disadvantages can be shown to inhere in 
such a procedure, which is undertaken in the belief that 
the investigator’s audience speaks his language and ought 
to have no difficulty in interpreting his statements. Partially 
from the abundant evidence that this is not always the case 
has come the development of symbolic logic and its increasing 
use as a tool in theory construction. Natural languages pos- 
sess many ambiguities which are largely but not entirely re- 
solved by the considerable redundances furnished by the 
context. Also disadvantageous is the process by which the 
research worker classifies phenomena together only because 
they happen to be classified together as a result of their com- 
mon nomenclature in his natural language. Instances in 
Which this procedure is fruitful become increasingly rare as 
a science develops. 2 

From such difficulties has sprung the conviction that the 
unambiguous definition of concepts (propositional variables) 
is a desideratum. Two kinds of definitions may be distin- 
guished: the formal and the operational. Formal definitions 
of the sort termed “explicative nominal definitions” by the 
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logician consist in placing the term to be defined on one side 
of an identity sign and some other term or terms on the other. 
These other terms may be previously defined or may be 
undefined notions (primitive terms), chosen either for their 
transparency or for their extreme difficulty of definition. 
Formally speaking every system has at least some undefined 
terms, unless it is characterized by circularity of definition, 
which is prohibited by the ground rules. Formal definitions, 
then, are purely theoretical, i.e. verbal or pencil-pushing 
activities, and are most useful in and around those postulates 


that state the logical and mathematical assumptions of the 
system. 


rs (operations), such as reading a 
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Since the concepts are operationally defined, the theory 
specifies what results should be regarded as supporting the 
theorem and what should be taken as failure of prediction. 
It is characteristic of loosely formulated theories that in 
some circumstances any result is taken as support of one 
theorem or another. These theories thus “explain” after 
the fact whatever happened, but can deliver no predictions. 
No theory known to us can predict in all situations, or with 
100 per cent probability of success in any situation; the dif- 
ference between theories is thus one of degree. It can merely 
be asked of the theorist that he try to confirm only testable 
theorems and that he be prepared to accept the consequences 
of failure of prediction. 

Failure of prediction ought ideally to indicate the falsity 
of one or more postulates. Actually, in the behavior sciences 
failures are often considered traceable to inadequate observa- 
tional techniques, “folksy” or nonoperational definition of 
concepts, incorrect derivation of theorems from postulates, 
Insufficiency of the postulate system, or inconsistency of the 
Postulates. There can be many a slip between postulation and 
observation, and it is often difficult to ascertain precisely 
Where the trouble is to be found. 

„Much of the development of science has consisted in em- 
pirical work supported by a minimum of theory. Requiring 
only the definition of concepts, this activity can then proceed 
to classification by one criterion or another and the correla- 
tion of certain data with other data. It is a type of research 
Which plays a great role in the beginning stages of any sci- 
ence, since the generalizations (empirical laws) arrived at 
form the basis for many of the crucial choices of postulates 
1n the Succeeding construction of theory ; it is less profitable, 

Owever, in later stages, when unifying theories have been 
Constructed which offer predictions about wide ranges of new 
Phenomena. 

n most situations involving human behavior we are at the 
empirical law-gathering stage. The empirical generaliza- 
tions Sought have tended to be of two varieties: on one hand, 
the Correlation between earlier stimulus conditions and later 
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behavioral results, and, on the other hand, the correlation 
of behavior at one time with behavior at a later time (Spence, 
1944), 

It should be obvious that theorizing activity does not pro- 
ceed in a vacuum. Definition of concepts is highly dependent 
on available observational techniques; postulates concerned 
with such concepts must be framed with an eye to the logical 
derivation of testable theorems; and the character of the 
postulates serves as a guide to the development of new ob- 
servational techniques or the refinement of those already 


existing. Such interplay is constantly under way in any 
vigorous science. 


FORMAL Inrrcration 

This book represents a circumscribed attempt in the direc- 
tion of what we here call formal integration. Confusion and 
disagreement over the meaning and significance of inter- 
disciplinary integration are apt to ar 
circumstance that ther 
tegrative activity: for 
tion,? and policy integ 


as we use the term, is concerned with curric- 
ulum arrangements, more particularly with the attempt to design interdisci- 
itional departmentalized) science courses. In 
in this context consists in rationalizing the whole 
“upon set of pedagogical objectives, 

and of the larger Program of which it is a part. In 
to be sure, a useful exercise to make objectives 


ystematic appraisal and rationalization of the 
ese. However, 


this process i 


y iplines can be related one to the 
aone riagogical purposes. Lacking this, the attempt to design inter- 
3 y science d upon such pedagogical ob- 
ter continuity (whatever that 
rly attainable via a particular 


Seaton ce ae on the matter of pedagogical integration has the simple 
arning that disagreement and confusion over the meanings 


nt motivation and bet! 
may mean), which are s 
curriculum arrangement. 
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tite categorization is not a tight one. For example, the results 
of formal integration, once accomplished, will manifest them- 
selves in the classroom and in policy decisions. Nonetheless, 
a recognition of these distinctions is helpful. The meaning 
of formal integration of theories can best be understood by 
first discussing the relations between theories. 

The statements comprising any theory may be divided into 
two general categories: 1. those statements of attributes of 
and relations among phenomena which the theory takes as 
given (one of the two classes of elements previously referred 
to as postulates), and 2. those statements of relations among 
and attributes of phenomena which the theory attempts 
to explain.* 

. In these terms any two theories, A and B, may be related 
in a number of ways: 

1. The theories A and B undertake to explain at least 
some of the same phenomena. 

2. The theories describe and explore the consequences of 
at least some of the same given elements. 

_8. Theory A attempts to explain some of what B takes as 
given, and B describes and explores the further consequences 
of some of what A explains. 

4. A final relation may be distinguished as conceptually 
somewhat different from the preceding in that it refers less 


Significance, ete. of integration of the sciences may arise if one party to a 
discussion has in mind the problems and objectives peculiar to the peda- 
gogical side of the matter whereas another party is considering some quite 
different set of objectives and problems. 

8. Numerous policy decisions (e.g. economic and political) require knowl- 
edge of the limitations and probable consequences of these decisions, which 
is often best gained from specialists in various sciences. Here integration 
requires that specialists express themselves with respect to the consequences 
of alternative policies and that their estimates be presented to the policy 
maker. Policy integration, so conceived, is to be distinguished from the 
process of normative evaluation which often must accompany a policy deci- 
sion. Normative evaluation is concerned with resolution of conflicts between 
the ultimate goals or objectives of the policy decision, as opposed to simply 
Predicting the probable outcome of the policy decision. 

4. An event is said to have been explained if a proposition predicting its 
occurrence has been deduced as a theorem from a set of postulates and the 
event is indeed observed as predicted. Henceforth, circumlocutions intended 
to distinguish between the formal theory and its phenomenal referents will 
be dropped. 
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directly to the phenomenal reference of the theory. Some of 
the research techniques peculiar to one discipline (e.g. inter- 
rogation techniques) and/or some of the formal properties 
of its theoretical formulations (e.g. particular mathematical 
techniques or formulations, previously referred to as a part 
of the postulational structure) may be fruitfully applied 
to the study of phenomena with which another discipline is 
concerned. (We refer to research techniques and formal 
properties of systems which may be more or less peculiar to 
the disciplines in question rather than to such of these as are 
the common property of all scientific disciplines.) 

Relations among theories are states of affairs existing at 
some point in time. Formal integration of two related theories 
consists of two things: 1. simple awareness of the relations 
listed above, and 2, extension of relations, including modifica- 
tion of the theories when they contradict one another. For 
example, A implies a Proposition contradictory to one postu- 
lated or implied by B. In any such instance both A and B 
cannot be correct about the point in question, and the dis- 


covery of the contradiction presumably compels an attempt 
to discover the source of error, 


A numb 
n be distinguished. Some of these co 


ch for more adequate 
theoretical approaches, and research 
often begins when the scientist dis- 
tisfactorily answer particular ques- 
ne suspects that the kinds of theoretical tools 

is familiar ma 
egin the sear 
which to attac 


nren 
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one other motivation for integrative activity may be men- 
tioned, namely the aesthetic. Suppose that from the postu- 
lates of theory A we can deduce, as theorems, the postulates 
of theory B. If for the moment we define a new theory, AB, 
it will now have fewer postulated (unexplained) relations 
than did the old theories A and B taken together. In other 
words, the combined theory is more parsimonious than were 
the two previous ones taken together. It is true that if such 
an integration is achieved new and independent evidence 
will have been brought to bear on the truth value of the 
propositions comprising both A and B. Aside from this, how- 
ever, the benefits of the procedure may be largely aesthetic; 
that is, the new theory AB may contain no more and no dif- 
ferent propositions than did the old theories A and B taken 
together. And there may be no diminution in the knowledge, 
skills, and work necessary to arrive at those propositions in 
the new theory AB which before were separately the concern 
of A and B. 

_ This enumeration of the motivations for formal integra- 
tion could be considerably extended. However, it is perhaps 
wise to cut it short at this point, since for most scientists a 
discussion of the possible merits of integrative activity pro- 
ceeds best in terms of particular examples, some of which 
will be found in the balance of this book. 


CHAPTER 2 
HULLIAN THEORY 


T considering problems which arise in extending stimu- 


tions of Hull (1943a, 1951, 1952), Spence (1951), Miller 
and Dollard (1941), and Dollard and Miller (1950). How- 


mental features of Hull’s model 
to two related topics important for underst 
proach: 1. the relation of Hull’s th 
the problem of quantification. 


anding this ap- 
eory to Physiology, and 2. 


-variable approach to theory construction 
egins with the Proposition that behavior science seeks to 


dict | À a given environment, 
or, in different terms, 
tain stimuli. Such pre 
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of statement treats behavior in a given situation as a function 
of the organism’s prior experiences, taking into account the 
degree of similarity between present and past situations. 
Both types of statements concern empirical phenomena: the 
first gives the organism’s past history, and the second sum- 
marizes, in the form of empirical laws, relations between 
observed data. By combining the empirical laws with the 
Specific statements about the organism, predictions can be 
deduced as to the latter’s future behavior. The question now 
arises, how should the general statements regarding behavior 
be organized? Should they be left as empirical laws, or should 
they be cast into some other framework advantageous for 
making predictions? 

The intervening-variable position proposes that the gen- 
eral laws be organized in terms of a model, or constructed 
organism, which will have all the input-output properties 
demanded by these laws. This is accomplished by relating 
certain classes of stimulus or antecedent conditions * to one 
or another variable in the model. These variables in the model 
are termed “intervening variables” and must be related in 
turn to others which are themselves related to measurable 
aspects of behavior. The transition between intervening vari- 
ables defined by antecedent conditions and those defined by 
response measures can be made by means of still other inter- 
vening variables, which bear unambiguously stated relations 
to the two former sets. 

The development of an intervening-variable system should 
follow certain restrictive rules. First of all, each intervening 
variable should be defined operationally. It should be un- 
ambiguously related to empirical operations or to other inter- 
vening variables which have been defined in terms of experi- 
mental operations. This does not mean, however, that the 
first definition is the final one. Intervening variables may be 
partially defined and further content may be added to their 
——— 
lows a response without regard to any possible causal relation between 
event and response. 

8. By stimulus conditions is meant the immediate environment in which 
the organism is operating; antecedent conditions refer to the organism’s past 
experience, 
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definitions as research progresses. Secondly, as new laws 
of behavior are discovered, a model composed of intervening 
variables may change in its components or in their relations 
in order to conform to observed stimulus-response laws. 
Some of these new laws may be deduced from the model ; 
others may not be deducible and may therefore demand modi- 
fication of the model. A final restrictive rule is that the model 
should contain as few intervening variables as possible. 
Every independent empirical operation could be represented 
by an independent intervening variable; but this situation 
would make an intervening-variable model a mere exercise 
in choosing synonyms for each of a number of terms. 

This method of theory construction, then, proposes that 
a set of hypothetical interrelated intervening variables be 
defined, directly or indirectly, in terms of stimulus or ante- 
cedent conditions on the one hand and response measures on 
the other.* An adequate system will successfully imply the 
input-output relations discovered as empirical generaliza- 
tions on the behavior of actual organisms. 

By design, this initial discussion of intervening variables 
has been rather general. A more detailed discussion of their 
development and use will be best understood after the reader 
has had some introduction to the Hullian system, a brief 
summary of which will now be presented. 


Tur Huztayn THEORY 


The Hullian theory ® considers behavior as the event to be 
described and predicted. Behavior is viewed as a response 


4. See above, p. 6. The reader should Tecognize, however, that an inter- 
vening-variable system may Properly contain some constructs which specify 


State characteristics of the model organism, and that these characteristics 
need not be explicitly related to stimul 


Hullian system, for example, the concept reaction t 
such a state characteristic, Similarly, the parameters of the several equations 
in the system partially reflect individ 

upon any specifiable stimulus conditi 
ans of estimating t 


they are useful only if 1, their rel 
terms are explicitly stated, e difer in value among the 
groups of organisms being studied, 


5. We will not present the system in postulat 
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(R) of the organism evoked by the stimulus complex (S) 
impinging upon his sensory apparatus. The theory, then, 
seeks to predict R when S is given. This prediction is accom- 
plished by using intervening variables which are related to 
observable stimulus and antecedent conditions on the one 
hand and to observable response measures on the other. 
Values of the S conditions are transformed by the system 
into values of intervening variables, and these in turn are 
transformed into values of the R dimensions. 

An S initiates a stimulus trace (s) which is related to the 
qualitative and quantitative aspects of the stimulus complex. 
Hull assumed that the trace increases rapidly and then de- 
creases more slowly with the passage of time after the onset 
of S. The R bears a one-to-one relationship to a hypothetical 
intervening response (r). According to this scheme, 


S—>s---r—>R, 


the prediction of R from S becomes a problem of predicting 
r from s. This is performed by the rest of the theory. 

The r is a function of response tendency (sEr) ;° r, and 
hence R, is assumed to improve monotonically with increases 
M response tendency. Improvement in R is reflected by an 
Increase in its probability, amplitude, etc. That is, 


S—> s— skr —r—— R. 


_ Response tendency is defined as a function of the interac- 
tion of several intervening variables which are related to ob- 
Servable stimulus and antecedent conditions. Some of these 
— 


complete exposition of its applicability to the several areas of psychological 
inquiry. Such a presentation is beyond the scope of this document and is 
available in the references cited above. We will offer, instead, a minimal out- 
line of the theory as it has previously been published, without reflecting those 
further modifications which any of the present writers favor; eg. while our 
discussion of “reinforcement” will offer a possible alternative definition of 
this concept, we shall state in this chapter only those definitions already 
Published, Accordingly this summary should not be taken to represent the 

cory which the writers would ultimately apply to social behavior. 

6. Hull wrote the subscripts in capital letters. Because the small-letter 
Subscripts are more appropriate to his system, and also because of printing 
Simplicity, they are used here throughout. 
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variables act to increase, some to decrease, response tend- 
ency ; the three positive ones are habit, drive, and incentive. 

The associative (learning) intervening variable is called 
habit (sHr) and is assumed to increase toward an asymptote 
according to a negatively accelerated monotonic function 
with the number of reinforced trials (N). Thus the two 
necessary and jointly sufficient conditions for the accretion 
of habit are: 1. a reinforcing state of affairs following 2. 
a trial. A trial is the temporal contiguity of the s and the r. 
The concept of reinforcement may be viewed as a category of 
states of affairs into which an event is placed after research 
has shown that its occurrence on one trial is followed by an 
increase in the probability of a repetition of that R on a sub- 
sequent presentation of that S.7 Hull, and Miller and Dollard 
have adopted the specific hypothesis that reinforcement is a 
drive reduction; i.e. that an event is reinforcing if and only 
if some drive (defined below) is reduced. 

The second positive comp 
drive (D). The primary driv 
food, water, or sex, or to the ph 


i any and all responses attached 
(via habits) to the §. However, each drive is assumed to pro- 


(Sp) behavior specific to parti 
this mechanism, 
The final iti i re 
centive (K), which į sponse tendency is in 
tude and the ti 
response, 


tion of the intensity 
drive is specific to th 
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ism has experienced these reinforcement conditions. Incen- 
tive, drive, and habit are assumed to interact multiplicatively 
in determining excitatory potential (sEr), which vanishes 
if any component goes to zero. Since sHr approaches an 
asymptote as a function of the number of reinforcements, 
sEr must also approach some asymptote. 

A previously neutral stimulus which repeatedly precedes 
a noxious one acquires motivating effects; this secondary 
motivation contributes to the total drive. Similarly, a previ- 
ously neutral stimulus will acquire secondary reinforcing 
effects if it repeatedly precedes a primary reinforcing state 
of affairs. Both secondary reinforcement and secondary 
motivation are presumably acquired according to the postu- 
lates of the system and are subject to ultimate extinction if 
the conditioning sequence does not occasionally occur. 

Thus excitatory potential has three major positive com- 
ponents, habit, drive, and incentive, each of which may be 
affected by the learning experiences of the organism. Two 
variables oppose excitatory potential: conditioned inhibi- 
tion and work inhibition. f 

Conditioned inhibition (sIr) accrues as an increasing 
function of the number of nonreinforced trials. Extinction 
1s thus deduced on the basis of an increase in conditioned 
inhibition rather than a decrease in habit. Work inhibition 
(Ir) accumulates with the performance of any response ac- 
cording to the work involved, and dissipates as a function 
of the time of rest. Work inhibition is developed on both 
reinforced and nonreinforced trials; it accordingly tempo- 
rarily facilitates the extinction process. Conditioned inhibi- 
tion and work inhibition each subtract algebraically from 
excitatory potential. The remainder, called effective excita- 
tory potential (sEr), is considered the maximum value of re- 
Sponse tendency possible at given levels of training, motiva- 
tion, and reinforcement. 


Effective excitatory potential, however, fluctuates ° 


| 2: While this fluctuation, at the present stage of development of the theory, 
of measurement and the 


1S partially a residual factor resulting from errors 
effects of currently unknown determining variables, it is also held to be par- 
tially a basic characteristic of the model organism. That is, while the variance 
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through time; response tendency is the effective pipe 
potential present at the time of observation. This is the apne . 
of positing oscillation (sOr) as a normally distributed, pe? 
domly determined variable which changes from moment ' 
moment according to this distribution, and of defining re- 
sponse tendency (sEr) as the algebraic subtraction of oscilla- 
tion from effective excitatory tendency. 

All associative variables (h 
centive, and conditioned inhib 
generalize to any similar S 


celerated decreasing function of the difference between the 
latter S and the original S. 


Whenever several competing R? 


S are attached to an S, 
that R is performed which has th 


e highest momentary re- 
tendency oscillates, the R 
not always occur, because 
at some moment, chance to be 


an a competing R whose aver- 
s. The probability of an 


its response tendency may, 
reduced more by oscillation t 
age value is les 


This survey of the Hullian system has not included several 
aspects which ar i i 


response threshold. We also 
have not shown the detail of t i 


owever, it is hoped that the major concepts to which we 
a 


of the oscilla 


tion distribution may be 
advance, the 


reduced as our knowledge and skills 
limit of this reducti 


on is above zero, 
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shall subsequently refer have been introduced in the context 
which gives them their meaning. 


Technical note: incentive motivation. It was stated that incentive 
(K) is dependent partially upon the magnitude and the time of 
delay of reinforcement following a response and partially upon 
the number of times the organism has experienced these rein- 
forcement conditions. 

Although this statement substantially reflects the Hullian 
Position, the importance which we shall attach to this concept 
for predicting social behavior perhaps warrants a more detailed 
historical and analytical description. In the next to last version 
of his system, Hull postulated one variable (K) to be a function 
of the magnitude of reinforcement (where this magnitude is con- 
stant over trials) and another variable (J) to be a function of 
the delay of reinforcement, without direct reference to the learn- 
ing experiences of these reinforcement conditions afforded the 
subject. At that time Spence suggested that these two variables 
could be combined and that the learning experience of the subject 
should be taken into account. Hull partially adopted this posi- 
tion in the last version of his theory and subsequently informed 
One of the present writers by personal communication of his ac- 
ceptance of Spence’s suggestion in toto. 

_According to this position, a motivated organism confronted 
with a primary reinforcing stimulus performs an appropriate 
goal response (1g) which is isomorphic to the observable Re, eg. 
eating. Any stimulus which regularly precedes this re will ac- 
quire a tendency to evoke it (because the stimulus trace overlaps 
the rg affording contiguity, and because the goal stimulus itself 
Provides the reinforcement). Since the goal response cannot 
occur without the goal stimulus itself being present, it is hypoth- 
esized that only a portion of the rg becomes conditioned to 

hose stimuli preceding the goal stimulus. This portion is called 
€ fractional anticipatory goal response (Tg); and incentive 
(K) is then assumed to be a function of the amplitude of ry. : 

Since Tg must become conditioned to the stimuli evoking an in- 
strumental act, the K for such a response is partially determined 

Y the number of trials in the acquisition (or extinction) of rz. 

Ccordingly, incentive is itself acquired on the basis of the or- 
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ganism’s learning experience. Further, since the magnitude of 
the goal stimulus will determine the amplitude of the goal re- 
sponse (and therefore the r,), and since the delay of reinforce- 
ment will determine the time interval for the conditioning of rg 
the amplitude of r, and hence K will also partially depend upon 
the magnitude and delay of the reinforcement. 

(It may seem circular that response tendency is a function 
of a variable which is in turn a function of response tendency. 
But the incentive component of the tendency to perform the in- 
strumental response is dependent upon tendency to perform the 
fractional anticipatory goal response. The latter response tend- 
ency refers to a classical conditioned response for which, accord- 
ing to the Spence position, no incentive variable is relevant.) 

Although r, has the status of a hypothetical intervening vari- 
able, it will perhaps be instructive to illustrate this derivation as 
if it were observable. If the goal stimulus is food, the goal re- 
sponse is eating, and we may for illustrative purposes identify 
the r, as surrogate chewing responses. If we then visualize a rat 
running dow. 
this locomotion at any point on the alley will de 
amplitude of these surrogate chewin 


because habit requires & 
; e, the tendency to perform 
chewing responses (i.e. r, and hence K) will not 
y. Accordingly, the incentive com- 


number of tria 
the surrogate 


(in this case alley stimuli) is 
ef initial inversion, to the time 
stimulus and the unconditioned 
)- (This law is derived by the 


» except for a bri 
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theory on the basis of the stimulus trace function.) Since stimuli 
m the first sections of the alley are necessarily further removed 
2 time (as well as space) from the goal stimulus than those near 
e goal end, the tendency for the surrogate chewing response 
to occur to the former will be less than to the latter. Accordingly 
Yg and therefore incentive (K) will be larger nearer the goal. 
In this manner is derived the statement made above, that in- 
e (K) is dependent partially upon the magnitude and de- 
pid of the reinforcement and partially upon the number of times 
© organism has experienced these reinforcement conditions. 
This analysis appears to work satisfactorily for a simple in- 
strumental response such as running down an alley maze. The 
i any porni in the maze become conditioned to rg and, by 
Thate it, provide for the K for the instrumental response. 
i is, the amplitude of the r, active at any moment determines 
he K for the instrumental behavior at that (or the immediately 
succeeding) moment. 
oe happen, however, if the organism were confronted 
ian comet choice or discrimination problem where the (two) 
aan Ing responses are followed by different magnitudes (or 
ee ag reinforcement? To that stimulus complex which im- 
hse ely precedes the choice, a greater amplitude of Te will 
lar - conditioned on the basis of the response receiving the 
si magnitude of reinforcement than on the basis of the re- 
a eoe the smaller reward. Theoretically we can sep- 
tee p amplitudes of A conditioned to the choice stimulus 
it me one appropriate amplitude from each response. But 
oe ms logically inconsistent that two different amplitudes of 
cnn can coexist; moreover, this position would require the 
Sabin aoe of some higher-order property in the organism ca- 
ie o directing the two K’s determined by the two rg’s upon 
slt appropriate response tendencies. Let us examine possible 
ernatives to this description. 
Bs could, of course, assume that the 
wills SuMatego that a single amplitude of Tg 
in ra rovide a single K which could be held to mu 
e same way that Hull provides a single D wh 
as a classical conditioned 


separate response tend- 
will occur. This 
Itiply all habits 
ich multiplies 


10, 
pine should be noted that the evocation of Tg 
Se does not entail a K factor. 
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all habits. However, while the single D notion may prove ade- 
quate, the single K notion does not appear to be useful. Each of 
the drives provides a characteristic drive stimulus (Sp), and 
when several drives are present and summate into a single D, 
choice behavior can depend upon the responses conditioned to 
each Sp. But no such characteristic stimuli can be found if the 
response tendencies for r, summate to determine a single K. 
Because the basis for choice must be the difference in K’s for the 
competing responses, a single K solution is inadequate. 

A second alternative would argue that vacillation occurs at 
the choice point, that stimuli contingent upon orienting acts pre- 
ceding one response evoke the rą appropriate to that response, 
and that such stimuli preceding the other response evoke the ap- 
propriate r,. For example, a rat in a T-maze looks first up one 
arm and gets stimuli which evoke one amplitude of r, dependent 
upon the reward in that arm, and then looks up the other arm and 
makes the r, appropriate to the reward on that side. In this man- 
ner, then, the two different amplitudes of rẹ, can be evoked at 
different times and could be held to set the K’s corresponding to 
the differential reinforcements. Since the r,’s occur at different 
times, however, the organism must be provided with some higher- 
order process which will receive and store the now separated K’s 
until a decision is reached as to which response will occur. For 
that matter the basic problem is only postponed by this descrip- 
tion, for the theorist must now turn to an explanation of why 
the vacillation occurred in the first place. Why, that is, should 
a rat that has nosed into one alley and set a K and resulting re- 
sponse tendency to traverse that arm suddenly hold this response 
tendency in abeyance until it surveys the alternative responses? 

While this second alternative may prove to be the most useful 
description, some of the writers hold a tentative preference for 
a third possibility which requires that the symbol K be changed 
to sKr in order to denote that it is specific to a particular 
stimulus-response connection. According to this position the 
sKr for any response on some trial is set by the amplitude of rg 
which occurred on the preceding trial. In the choice situation the 
sKr’s are specific to the particular responses; sKr, and sKrz 
at any trial are dependent upon the amplitude of rẹ on the pre- 
ceding occurrences of rı and rp respectively. The two sKr’s then 
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enter into the determination of the competing response tenden- 
cles. 


RELATION TO PHYSIOLOGY 


We have briefly described the intervening-variable ap- 
proach and the system resulting from Hulls use of this 
method of theory construction. The intervening variables 
describe the hypothetical content of a model organism which 
yields the same input-output (S-R) relations as have been 
observed in the behavior of actual organisms. Thus, for ex- 
ample, a rat’s behavior is seen to vary systematically with 
changes in the number of hours of deprivation of food. Ac- 
cording to the theory, such deprivation conditions produce 
drive (D) inside the model organism, and changes in this 
drive produce variations in response tendency (sEr) and 
hence in performance. The system is useful for predicting 
behavior if the model organism and the real organism yield 
the same S-R relation. This is the basis for such statements 
as: The rat behayes as if he had a drive produced by depriva- 
tion of food. 

The relations between intervening variables in a model 
organism and actual physiological events in a real organism 
have frequently been debated. Many behavior scientists in- 
sist that an intervening variable has nothing to do with any 
physiological phenomenon. A more moderate statement 18 
that an intervening variable bears a relationship to a physio- 
logical event only when the behavior scientist chooses to 
define the intervening variable in that way. As long as the 
theorist does not introduce physiological terms into his par- 
tial definitions of intervening variables, however, the physi- 
ologist cannot contribute directly to the development OF 
verification of such a behavior theory. A physiological inter- 
Pretation does not have to be given all intervening variables 
at once. It is possible to attempt such an interpretation of 
one or a few, as the behavior theorist may decide. Even this 
degree of coalescence between physiology and behavior 
theory, although an admirable aim, seems remo 


te at present. 
Behavior theory as presented here does not offer the physi- 
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ologist any useful research orientation until some physio- 
logical interpretation is given to intervening variables. On 
the other hand, any model of the organism developed by 
physiology must account for the actual stimulus-response 
relations observed in behavior. Thus behavior investigations 
place limits on the type of model the physiologist can offer. 

As Spence has pointed out, mere labeling of intervening 
variables with physiological terms docs not constitute an 
adequate interpretation of those variables. One class of inter- 
vening variables which is highly susceptible to such a casual 
physiological interpretation is the so-called “internal re- 
sponse,” such as fear and rg. Real organisms, however, do not 
necessarily make such responses. These internal responses are 
merely part of the theory, and their use in a theory does not 
justify their reification as an actual response by a real organ- 
ism. A real organism may perform responses which could be 
labeled “fear” or “r,. but until such identification is made 
it is gratuitous if not confusing to talk as if real organisms 
make them. The actual identification of these internal re- 
sponses seems a physiological problem. 

Within an intervening-variable theory, the use of internal 
responses is quite legitimate. Naturally, like any other class 
of terms in such a theory, they should be kept to a minimum, 
particularly since they have the tendency to multiply with 
great rapidity and since calling a term like “r” an internal 
response encourages its reification, 

Intervening variables, then, 
be explicitly related to an 
of these intervening varia 


are constructs that may not 
y physiological events. The nature 
bles was described in general in an 
earlier section of this chapter. We wish now to give somewhat 


more detailed and specific discussion of the nature and use of 
an intervening-variable system. 


QUANTIFICATION 


y instances such precise 
ventually achievable, many difficulties 
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are apt to preclude its immediate attainment. In such in- 
stances the investigator may make some use of only partial 
knowledge about a given functional relation, for example, 
some knowledge regarding the sign of the slope of such a 
relation or, more restrictively, some knowledge of its curva- 
ture. The use of such general knowledge requires special cir- 
cumstances. For example, assume a theory of the form 
X(Y, Z), where X is an increasing function of Y and a 
decreasing function of Z. In any such case, if our problem 
involves a simultancous increase or decrease in the values y: 
and Z, no prediction can be made even as to the direction of 
change in X, given only ordinal information about the rela- 


tions X (Y, Z), etc.!2 This aspect of the quantification prob- 
lem is all a familiar story in the social sciences. Were the 
Hullian theory stated directly just in terms of the ob- 
servable variables in question, and thus in the form R(N, h, 
Wg, . . .), we could drop the whole discussion of quanti- 
fication at this point, since quantification of the theory 
Would involve no more than the usual problem of statistical 
estimation of the parameters in any such expression. How- 
ever, the Hullian theory utilizes intervening variables, being 
stated generally in the form R(E), and E[H(N), D(h), 
K(Wg), a: -],18 where E, H, D, K, . . . are the interven- 


ing variables we have previously mentioned. . 

It is the presence of these intervening variables in the 
formulation which creates certain unique problems for quan- 
tification. In this case, quantification involves more than the 
usual statistical and mathematical problems of estimating 


11. In addition to those already encountered, the following terminological 
conventions will prove helpful in the discussion to follow: Ț 4 

Let X(Y) mean X is some function of Y; X(Y, Z) mean X is some function 
of Y and Z, ete.; and X(¥, Z) mean X is some function of Y and Z, Y held 
constant, ; 

12. We should perhaps note that much of the data input to the ces 
analysis has been obtained by making observations upon the effects of one 
independent variable at a time, all others held constant. There is, of course, 
nO guarantee that data gathered by making observations upon X(Y, Z) 
and upon X(Y, 2) will prove adequate to predict the results of the more 
general situation in which both Y and Z are allowed to vary. 

ia: Neglecting inhibition, oscillation, the multiplicative form a cee 
Pression, ete. These simplifications will not affect the subsequent discussion. 
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the parameters in an expression such as R(N, h, Wg, . . .). 
In addition, the quantification problem is one of a satisfac- 
tory quantitative conceptualization of relations such as 
R(E), H(N), ete. 

In order to illustrate the special quantification problem 
confronting an intervening-variable system, let us describe 
a particular instance in which the model was used to yield 
a relatively precise prediction. This example represents work 
done in the psychology laboratories of the State University 
of Iowa under the direction of Professor K. W. Spence (see 
Ramond, 1954). 

The problem posed in this instance was the prediction of 
the behavioral effects of employing a novel training proce- 
dure. Information was provided concerning the rate at which 
rats learned to approach and touch a bar to obtain food. 
The question was whether the experimenter could use this 
information and the theory to predict the animals? preference 
for one of two bars, when the training procedure insured a 


some such prediction, 


The apparatus consisted of a small triangular-shaped 
box containing two retractable bars. Hungry black-hooded 
rats were admitted to this box from a starting alley when 
a door was raised; the response of touching a bar resulted 
in the receipt of a small pellet of food. Each bar could be 
or both could be illuminated simul- 
livered only if the rat touched an 
at, then, had to learn to enter the 
response chamber, approach the illuminated bar, and touch 
it. Tf both bars were illuminated he was rewarded for touch- 
ing either bar. During trials when both bars 


Hullian Theory Q7 


_ First a group of rats was run to a single bar and the result- 
ing learning curve was obtained. Only one bar was necessary 
for this part of the study, but half of the animals were run 
to one bar and the remaining half to the other bar in order 
to control for possible initial preferences. On each trial any 
particular rat, then, entered the response chamber and found 
the right bar, say, illuminated. As soon as this bar was 
touched, he received a pellet of food and was then removed 
from the apparatus to await his next trial. Three such trials 
Were given each day. 

On each trial the time required to touch the bar was meas- 
ured and its reciprocal was recorded as response speed. This 
speed was found to increase as training continued, eventually 
reaching an apparent asymptote. The experimenter thus 
discovered the functional relationship obtaining for this type 
of subject in this apparatus between response speed and the 
ordinal number of reinforced trials. Conventional curve- 
fitting techniques were employed to specify this function in 
exact quantitative form. F 

_ Without further transformation of this empirical func- 
tion one might only assume reasonable invariance in this 
relationship and thereby predict that a replication of the 
above study would yield an essentially duplicate quantitative 
finding. But we wish to show how a scientist could use the 
theory to assist in making a quantitative prediction about 
a outcome of the following quite different training proce- 

ure, 

Suppose one begins again with experimentally naive, hun- 
81y, black-hooded rats, and runs them in the apparatus three 
trials a day. Instead of illuminating only one bar on each 
of these three trials for any animal, both bars are illuminated 
on the first trial so that the subject’s preference can be re- 
Corded. Then, on the remaining two trials of each day the 
Practice is distributed in such a way that each subject re- 
Celves twice as many reinforced runs to one bar as to the 
other. Suppose an animal is to receive the greater number 
of trials per day to the right bar; on those days when he 
Selects the left bar on the first trial, one illuminates (and 
£ ereby forces his response to) the right bar on both of the 
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remaining two trials. Should such a subject choose the right 
bar on the first trial, only the left bar is illuminated on the 
second trial and only the right bar on the third trial. 

By following this procedure the experimenter can record 
the per cent of trials on which one bar is chosen over the 
other and also insure that the one bar receives twice as many 
trials as the other. In the example where the right bar re- 
ceives the greater number of trials, how can the theory be 
used to predict the relationship between the per cent choice 
of the right bar and the number of days of training? 

The system holds that the per cent choice can be predicted 
from the difference in sEr’s of the two responses, touching 
the right bar and touching the left bar. It is necessary, then, 
to calculate how this difference in sEx’s will change as train- 
ing is continued. To do this the separate sEr’s must first be 
calculated. 

The theory states that response speed, denoted Q, is a lin- 
ear function of sEr. Accordingly in this particular problem it 
is unnecessary to decompose sEr further into its components. 
In this apparatus for this type of subject sEr(N) is some 
linear transformation of the empirical equation found for 
Q(N). Further, since one knows how many trials per day 
were given one can draw sEr as a function of days. If the 
change in sĒr is plotted as a function of the number of days, 
it is clear that N for the right bar will be twice that for the 


left bar, and its sEr curve plotted against days will therefore 
approach its asymptote at twice the rate at which the sEr for 
the left bar 


l approaches the same asymptote. The two curves 
will eventual] 


y converge and one can accordingly predict 
that the difference between them will begin at zero and at 
first will increase and later decrease. Further, since the sEr 
curve was stated exactly, the number of days at which the 
difference will reach its maximum, and the shape of its rise 
and fall, can be specified. 

The theorist can therefore generate ro re- 
lating the difference b i Ba aed 
bars as a function of 
theory states th 
function of this 
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is ogival in form. One can accordingly transform the differ- 
ence curve showing the curvature and point of maximum in 
the per cent choice curve. These predictions were confirmed. 

It was impossible to predict exactly how high the per cent 
choice curve would go. This prediction would have required 
two further specifications: 1. the linear transformation of 
Q(N) that would provide sEr(N) (so that the difference 
between the sEr’s could be specified exactly and not to a linear 
transformation), and 2. the size of the variance of the oscilla- 
tion distribution. 

Further, prediction of the results of changing some other 
variables (for example, the number of hours of food depriva- 
tion) would have required decomposition of the sEr(N) curve 
into its components. For illustrative purposes let us show 
how this decomposition is accomplished. : 

According to the postulates of the theory, sHr is deter- 
mined by the number of reinforced trials (N), K by N and 
the magnitude (Wg) and delay (Tg) of reinforcement, and 
D by the hours of food deprivation (h). The values of each 
of these relevant independent variables (N, Wg, Tg, and h) 
are known to the theorist. The sEr’s could therefore be 
calculated if he knew the values of the parameters of the 
equations relating the intervening variables (sHr, K, and 
D) to these independent variables. We wish to show how the 
empirical function Q(N) can provide some, though not all, 
of these parameters. Q(N) will yield the parameters of 
sHr(N) and K(N). $ 

Response speed is assumed to be a linear function of sEr; 
we know post hoc that the relationship sEr(N) must be some 
linear transformation of the equation Q(N). It is presumed 
further that D remains constant over N, so the product 
(sHr x K) as a function of N must also be a linear transfor- 
mation of the function Q(N). We must therefore simply de- 
compose some linear transformation of the relation Q(N) 
Into two equations, sHr(N) and K(N), with the restriction 
that the product of these latter two functions equals the one 
with which we began. $ 

In this partiln instance the ways in which sHr and K 
change with N are not independent. Since K is dependent 
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upon the amplitude of r,, that portion of the tendency to 
make r, which changes with N is the sHr,. Accordingly two 
sHr’s change with N, that for the instrumental response and 
that for the r,. If we add the restriction that the rate of 
growth of these habits is the same, we may perform a square- 
root transformation upon our original function Q(N), and 
the resulting equation then states the functions sHr(N) and 
E(N) 

In addition to illustrating the intervening-variable method 
of theorizing, this extensive deduction serves as a convenient 
stage on which to present several points regarding the quan- 
tification problem faced by Hullian theory. 

1. If any statements more precise than the “greater-than” 
variety are to be made, certain kinds of advance information 
concerning the particular subspecies of subject and the given 
apparatus must be available in order to permit estimation 
of the parameters of the relevant theoretical equations. This 
does not mean that the intervening variables are response in- 
ferred 15 in the sense that they depend for their estimation 
upon the behavior to be predicted. It is true that the param- 
eters of equations defining intervening variables can be esti- 
mated only with the aid of certain empirical data obtained 
from comparable subjects in a comparable apparatus. But 
these data can be obtained under conditions other than those 
about which we wish to predict, and the assumption of in- 
variance in these theoretical equations permits prediction 
concerning novel conditions. 

i Whenever the species of subject or the apparatus are 
c 


anged, the quantification system set up is inapplicable. For 


14. This specific square-root solution is presented for illustrative pur- 
poses. It holds only when del: 


‘ ay of reinforcement is zero and magnitude of 
reinforcement infinite, 

15. In one sense all hypothetical terms employed by social scientists are re- 
sponse inferred: obser 


vations of variations in behavior suggest to the scientist 
that these result from variations in some 


state of the organism. Improved per- 
formance suggested to Hull an increase in sEr; to Tolman the formation of 
a “clear” sign-gestalt-expectation; to Köhler the occurrence of a “good” 
gestalt. Such notions become genuinely useful to some scientists, however, 
only after further specification is made relating sEr (sign-gestalt-expecta- 
tions, or gestalts, or what you will) to some stimulus and antecedent condi- 
tions. Otherwise prediction is im 


p possible, since their values can never be 
known until after the behavior in question has occurred. 
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the Hullian theorist the advantages of a quantified system are 
sufficiently great as eventually to override this handicap. 
Perhaps some simplifications will be discovered, e.g. inhibi- 
tion may be found to increase at a constant ratio with the 
rate at which habit is accumulated, although the absolute 
values of inhibition and habit may vary. 

3. We have seen that the quantification methodology gen- 
erally results in decomposing some obtained function into 
several components meeting the restriction that they can be 
recomposed into the original equation by the principles of 
the theory. With only a single function there are an in- 
definitely large number of satisfactory decompositions. If, 
for example, one wished to decompose the function R(N) 
into E(N) and R(E), the second could always be satisfac- 
torily selected on the basis of any arbitrary selection of the 
first function. In this case the quantification solution is 
trivial. Indeed, there is no guarantee that with a large num- 
ber of quantitative empirical generalizations there is any 
solution, much less a unique one. Arriving at one solution, 
however, may assist the task of making exact predictions 
even though some other equally satisfactory solution could 
have been found. . 

4. Predictions are delivered by the system in its entirety, 
but it may nonetheless be possible to make relatively precise 
predictions on the basis of only partial quantification if 
some variables are held constant and do not therefore dif- 
ferentially affect the behavior in question. . 

5. The mathematical operations embodied in the theory 
can be applied only ordinally until exact quantification 1S 
attained. At the present time one cannot solve for values of 
sHr, K, and D, and perform the indicated multiplication. 
One can, however, make ordinal statements about changes 
In these variables. 

6. The theory can never be stated more exactly than the 
empirical generalizations upon which it is based. The need 
for precise systematic research is therefore accentuated. 


the most industrious at- 
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area has been that of Hull et al. (1947) and his associates (Glad- 
stone et al., 1947) in a series of articles on the quantification of 
reaction potential. This procedure involves a modification of 
the scaling technique introduced by Thurstone (1927, Case III). 
It is our opinion, however, that this particular procedure waa 
incorrectly conceived. Hull et al. (1947, p. 253) assert that this 
methodology constitutes a “strict operational definition of re- 
action potential,” a statement which, if accepted, would make 
reaction potential a response-inferred c 
disregards the fact that, in order to be 
must be calculated from stimulus an k 
Any construct which depends for its estimation upon the behavior 
which it was intended to predict is simply useless. 

The Hull methodology actually yields a new response measure 
which we might call “scaled speed.” This response measure is 
ations performed upon the obtained data 
which is, in principle, no different from a transformation of 


onstruct. Such a position 
useful, reaction potential 
d antecedent conditions. 


od requires that latency be (and Hull there 


Writes as if it were) a function of response tendency (sEr). In 
his system, however, latency i i 


A s determined by effective reaction 
potential (sEr) without osci i, 


changes from momen 
predicting a time pa 
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for sÊr to take on a number of values before the response oc- 
curs. Indeed, latency can be predicted on the basis of the proba- 
bility of a superthreshold sEr which is a function of the threshold 
and sEr. Accordingly, the methodology simply is not appropri- 
ate to latency data, although it could be applied meaningfully 
to amplitude which is determined by sEr. 

It should be recognized that the fact above voids Hull’s esti- 
mation of the shape of the oscillation distribution, since the 
variations in latency do not result directly from sÊr. However, 
Hull did change his system to hold that the sigma of oscillation 
changes during learning trials. If this is true then the method- 
ology suffers another technical fault. For this procedure scales 
the means of the distributions upon which the scale is based, 
but sEr is the upper limit of the oscillation distribution. When 
the sigma of oscillation is a constant, then the mean is constantly 
displaced from sEr and a scale of the means is linearly related to 
sEr. When, however, one assumes that the sigma of oscillation 
can vary, then the difference between this mean and sEr is not 
constant, and scaling the means does not provide a linear esti- 
mate of sir. The scaling procedure will be useful, therefore, only 
if the mean of the oscillation distribution, rather than its upper 
limit, is taken as sEr, or if the sigma of that distribution is as- 
sumed to remain constant. 

Scaled speed may have some extra value in testing more de- 
tailed deductions of a theoretical model and as such may be a 
Useful response measure. But it in no wise alters the basic prob- 


lem of quantification. 


CHAPTER 3 


DEFINITIONS AND PROPERTIES OF 
RESPONSES 


arise in the study of responses as dependent variables in 

behavior science. These problems concern 1. the definition 
and measurement of responses, and 2. the consistency of be- 
havior in a wide variety of situations. 


IÈ this section we shall take up two major problems which 


DEFINITIONS OF RESPONSES 


Any study using responses as dependent variables treats 
the actual behavior of an organism in terms of some set of 
categories or definitions of responses. When we discuss the 
response of salivation or the response of blushing, we ignore 


way reliability and fruitfulness become two standards by 
which one must judge a set of response definitions. Obviously 
these standards are related ; we must also add i 


sponses. We shall see that any method involv 
between two or all three of these standards. 
Definition of responses is a double operation. An observer, 
whether or not he is aided by some apparatus, must combine 
certain concrete instances of behavior; he also must separate 
some instances from others, In making response definitions 
34 


Responses 35 


the observer is limited by his apparatus or his perceptual 
acuity; he may be further limited by his cultural and, es- 
pecially, his linguistic background. Thus characteristics of 
the observer (and apparatus, where it is used) always impose 
certain ways of classifying various behaviors together and of 
separating still others. 

Social scientists appear to approach the problem of de- 
fining responses in four different ways. First, responses have 
been defined exclusively in terms of movements of the or- 
ganism; for example, “high front unrounded vowel” (Bloch, 
1948), and “left sneer” (Birdwhistell, 1952). This type of 
definition will be referred to as the “movement” type. Sec- 
ondly, responses have been defined with respect to some 
changes made in a piece of apparatus; for example, “bar de- 
pression” (Perin, 1942; Williams, 1938), and “strident” 
versus “mellow” sounds (Jakobson, Fant, and Halle, 1952). 
We shall call this the “apparatus” type of definition. A third 
way of defining responses has been with respect to one or 
more presumed direct effects, not further specified, on some 
organism(s) other than the one whose behavior is being 
categorized. As examples of this type of definition, which we 
shall denote the “other-organism” type, we have “realistic” 
versus “conventional” art styles (Herskovits, 1950, pp- 
378-439), and “gives information” and “agrees” (Bales, 
1950). Finally, responses have been defined with respect to 
some presumed internal state of affairs which the observer 
somehow “perceives” in the organism under study; we shall 
call this fourth type the “internal-state” method of defining 
responses; as examples, we have “shows tension” (Bales, 
1950) and “cathects” (Parsons, 1951). 

Two points arise from these distinctions between ways of 
defining responses. The first point, which is obvious from 
the examples taken from Bales, is that a set of response defi- 
nitions may use more than one of the four types of definition. 
The second point concerns the interrelationships between 
these four methods. We shall discuss this latter point more 
fully, but first we must make a distinction between responses 
and response aggregates. 

The difference between a response and a response aggre- 
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gate is always relative to some set of response definitions. 
For example, suppose that in using the other-organism type 
of definition we can distinguish a number of responses. Each 
element in the set defines a response. Now, we can take several 
elements from the original set and put them into one cate- 
gory; this new category is then a response aggregate with 
respect to the original set of definitions. Counting instances 
of a response and obtaining rates of performance may be 
viewed as ways of aggregating responses, but we shall discuss 
these latter topics when we treat response measures. Since we 
shall not deal with them here as one way of ag 
sponses, we will restrict the meaning of aggre 
only the combination of different elements of a set of re- 
sponse definitions. The reasons for the aggregation of certain 
responses are numerous; two obvious and frequent factors 


are convenience of application and the aims of the investi- 
gator. 
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tension,” will frequently be applied where the scientist can- 
not observe any of the responses defined by movement or ap- 
paratus, which make up the aggregate labeled “shows ten- 
sion.” Some undefined residue is left over and is not specified 
in terms of movement or apparatus criteria. This residue is 
a continual source of difficulty in treating responses, since its 
existence may prevent adequate communication of techniques 
or reliability of results. An investigator who cannot fully 
verbalize his response definitions may sometimes be able to 
train observers to make judgments agreeing remarkably well 
with his own. Apparently, along with many other factors, our 
natural language permits us to give rather consistent labels 
to cues from another person’s behavior, even though we can- 
not explicitly identify those cues. This circumstance, how- 
ever, leaves the investigator open to misinterpreting behavior 
or seriously distorting his observations, because of limita- 
tions imposed on him by his own culture. The danger of 
culture-bound ways of viewing behavior has been emphasized 
in the anthropological literature, and we will not repeat here 
what others have said on this topic. The development of a 
crossculturally applicable set of response definitions does not 
appear feasible to us as long as the usual common-sense re- 
Sponse categories are not fully reduced to aggregates of ob- 
Jectively defined elements. The ways in which one aggregates 
Such elements, however, may change from culture to culture, 
Just as in linguistics: what are allophones of a single phoneme 
in one language may be independent phonemes in another. 
We do not want to leave the impression that aggregation 
of responses is done only by taking elements from one set and 
relating them to elements in a second. Frequently, for exam- 
Ple, a particular problem requires that elements m a set of 
response definitions be aggregated according to some cri- 
terion of efficiency or “correctness” of performance. In a 
Problem-solving study the task may be so arranged i a 
few temporal sequences of responses, defined in terms 0 A 
Paratus, are “correct,” while all others are incorrec 3 
Within the aggregate “incorrect response, the experi- 
menter also may attempt to distinguish different types, or 
subaggregates, of incorrect procedures. Aggregation done 
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this way is usually determined by the particular demands of 
the problem and/or by the investigator’s interests; it often 
includes temporal sequences of individual responses instead 
of merely involving individual responses without regard to 
the “context” of other responses in which they occurred. In 
these cases aggregation is based on a criterion or goal which 
the investigator sets for his subject. Furthermore, in a new 
experiment certain response sequences which were once ag- 
gregated as “wrong” may now be aggregated as “correct.” 
Here, however, aggregation is still relative to some initial 
set of response definitions, and the reliability of the response 
aggregates is a function of the reliability of the initial refer- 
ence set. We can now consider in more detail each of the four 
methods of defining responses, since this discussion turns 
partially on the question of aggregation, which affects the 
reliability, ease of application, and generality or fruitful- 
ness of a set of response definitions. 
Internal-state definitions 1 have long been popular in social 
science because of their apparent ease of application. Insofar 
as they are based on elements in a common linguistic and cul- 
tural background, they permi 
cability, even when internal-state definitions are not reduced 
to objective definitions. The reliabjli i 
tion, however, is hampered b 
cultural background of the i 


re oad different ways 
hat wn personal back lay a 
significant role in the application of such ition Within 
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feel that such reduction can never be adequate. We do not 
know of any evidence which rules out for all time the ade- 
quacy of any reduction of internal-state definitions to other 
types. Perhaps some responses defined on the basis of internal 
states will never be reduced to an aggregate of elements based 
on criteria of apparatus or movement; to this extent, the 
social sciences using the former will always have an overlay of 
“insight.” We believe, however, that such an overlay can be 
considerably reduced from its present size. 

Considerations similar to those just outlined for internal- 
state definitions apply to definitions based on presumed ef- 
fects of a response on another organism. Through our nat- 
ural language such definitions are easily applied; but their 
reliability often may be low and they frequently involve the 
use of some insight on the part of the investigator. Similarly, 
such definitions often have been fruitful in the study of our 
own culture but are of dubious value when applied to other 
cultures. But even within a given culture, the use of this type 
of definition requires precise specification of the identity of 
the other organism, since effects on other organisms may 
differ from one individual to another. Actually other- 
organism definitions, instead of imputing internal states to 
the organism making the response, merely shift the imputa- 
tion to some other organism. Finally, many attempts have 
been made to reduce other-organism definitions to aggregates 
of elements from movement-based or apparatus-based sys- 
tems. Such aggregates may include movements on the part 
of the organism whose response is under consideration or 
on the part of the other organism used as the criterion for 
defining the response. The last case, where one studies the be- 
lavior of a second organism in order to categorize that of the 
first, offers one paradigm for investigating interaction. 

Under the rubric “apparatus definitions” we include those 
definitions of responses where the investigator observes (and 
counts) changes in a physical manipulandum in order to de- 
cide whether or not a response has occurred. Bar pressing is 
a classical example of this, as are responses recorded by a 
variety of electromechanical methods. The investigator ob- 
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serves only the apparatus and need not pay direct attention 


to the organism itself. But the investigator presumes a high 
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ment of the apparatus. Ex 
this method very heavily, 
permits comparisons of per 
In a wide variety of situ 
on the basis of apparatus 
response definitions ofte 
about the subject’ 
the investigator o 
defined by appara 
Other relations b 
those defined by 

Definitions o 


the organism and move- 
perimental psychology has utilized 
since it is generally reliable and 
formance among different species. 
ations, however, responses defined 
are hard to use; furthermore, such 
n suppress considerable information 
s activity. To overcome this last difficulty 
ften supplements recordings of responses 
tus with notes on the subject’s movements. 
etween responses defined by movement and 
apparatus will be discussed later. 

f responses based on movements have been 
used unsystematically and to 


se gether with other types of defi- 
nitions in many investigation 


ple, such definitions are use 


tional short cuts can be worked out as ith - 

AERE S ý z A n 
linguistics, without losing vita] aiftrmstion Ap eT =e 
seem far from having a workable P 
ment-based definitions, and other 


of more immediate use. 


| 


Responses 41 


INTERRELATIONS BETWEEN MOVEMENT AND 
APPARATUS DEFINITIONS 


We previously deferred discussion of the relations between 
Mmovement-based and apparatus-based definitions. These in- 
terrelationships are best brought out by considering two 
problems: first, the interpretation of Hull’s “molar-molec- 
ular” distinction in the light of our analysis of definitions 
of responses, and second, the role of the environment in estab- 
lishing response definition. 

Hull borrowed from Tolman the notion that the task of 
behavioral analysis was to study “molar” behavior, although 
this position was later modified (Hull, 1952). The concept 
of molar behavior implied that interest should be centered 
on response phenomena which emerge from the coordinated 
action of many muscle groups, as against a “molecular” 
analysis of the action of each single group. Actually, there 
18 no clear dividing line between molar categories and molec- 
ular ones, although discussion of this distinction has often 
proceeded as if a line existed. From our point of view it makes 
little sense to ask how molar is a given level of analysis; one 
can only ask whether a response defined by one criterion is 
an aggregate of responses defined by another. Molarity and 
its companion molecularity are useful concepts only in com- 
Paring two or more systems for defining responses. One sys- 
tem is more molecular than a second when the first breaks 
Into two or more separate categories a single response cate- 
gory drawn from the second. Furthermore, this relationship 
holds only for that single case, since it may be reversed for 
Some other response in the first system. The question of how 
molar behavioral analysis should be is answerable only in 
terms of the investigator’s interests and the techniques 
available, 

On first glance it might appear that single responses de- 
fined in terms of apparatus are generally more molar than 
those defined on the basis of movements. For example, a rat 
can press a bar in a large number of ways. But response 
definitions based on apparatus are not necessarily more molar 
relative to those based on moyements, as we know from elec- 


42 Behavior Theory and Social Science 


tromyography (see Gellhorn, 1953), 
are recorded from individual muscle 
distinguish electrical differences between two instances of be- 
havior that would be called the same on the basis of a move- 
ment definition. The molar-molecular distinction is not se 
erally applicable to the relations between apparatus-basec 
and movement-based definitions of response. The distinction 
may apply in either direction, depending on the apparatus 
used and the movements studied. . 
Definitions of responses based on apparatus require the 
organism to produce some change in the physical environ- 
ment surrounding him; but some categories of responses 
based on movements also reflect changes in, or relations of 
the organism to, the physical environment. For example, we 
might use “turning toward the window” as a response cate- 


gory, although it may involve the same movements as would 
“turning toward the door” 


where action potentials 
s. In this case one can 


observations, 


Where apparatus is available 
tudes, for example, of a single response defined by move- 
ments, this combined technique may add both precision and 
cumbersomeness to the investigation, Beyond this, however; 
the combination of apparatus-based and movement-based 
criteria for definin 
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which he wants to study. This problem has been discussed 
most frequently by psychologists, who have utilized ap- 
paratus-type definitions of responses, and has some im- 
portant theoretical implications. 

By “dimensions” of a response we mean the ways in which 

we can measure variations in that particular response. For 
example, suppose we have a (movement-type) response 
category, “raising the left arm.” This response may vary in 
magnitude, since the arm can be raised to different heights, 
or 1n speed, or in latency, and so forth. These variations con- 
stitute the dimensions of this response. We can divide the 
dimensions of a response into two major types: dimensions 
measurable on a single instance of a response, and those 
measurable only on multiple instances. For example, we can 
measure the latency or speed of a single response, but any 
Measure involving the frequency of a response can be ob- 
tained only by observing many instances of it. The most 
widely used measures of this latter type are rate, probability 
of response, and resistance to extinction; all these measures 
require observation of multiple instances of a response over 
time. There has recently been considerable discussion of 
probability of response (Skinner, 1950, for example), and 
1t seems worth while to devote some attention to the meaning 
of this term. 
_ Probability of response, which will be represented by p(R), 
1s often used as a response dimension partly because it can be 
measured when only some categorization of responses is 
available. For example, if responses can be classified into 
three kinds, one can assign probabilities to each on the basis 
of a simple counting procedure; the probability of a response 
is the proportion of times which that response occurred out 
of the total number of responses appearing. 

Unfortunately this formulation of the measurement of 
P(R) is only one of three types of measurement which have 

een discussed and used interchangeably in the literature. 
These three meanings of p(R) are as follows: 

1. p(R) is the proportion of times a response occurs out 
of the total opportunities for its occurrence. This measure- 
ment assumes that the organism is operating like a stable 
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input-output device over time. An example of this is a trained 
observer in a psychophysical experiment. 

2. p(R) is the proportion of a sample of different or- 
ganisms showing a response at a given time. Usually all these 
organisms have been given the same experimental treatment, 
such as a fixed number of reinforced trials. Most learning 
curves have been drawn up in this way. Such curves are a 
series of points determined by the usual population-sampling 
techniques. . 

3. p(R) is a measure of the “certainty” that an organism 
will make a given response within a fixed amount of time. For 
example, we are more or less certain that a friend will reply 
to a letter within the next week. This type of p(R) expresses 
a relation between a statement about future behavior and 


data concerning past behavior by our friend and by similar 
people. 


In recent studies of 
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type A measures and type B measures are very different. 
The populations sampled by each are distinct. Finally, type 
C measures of p(R) are needed to measure the probability 
of response for a single individual, when learning or extinc- 
tion is occurring. The type A measure assumes a constant 
probability, structure for the individual’s response reper- 
toire. This assumption is meaningless in learning situations, 
since there is no way of operationally specifying a probabil- 
ity. for the response under consideration. The assumption 
that one can assign a probability, measure to a response 
which is being conditioned in a single individual leads to the 
conclusion that such a measure can never be directly esti- 
mated on any one trial, since only one instance of that re- 
ponse for that probability. state is available. Empirical 
learning curves which show type B p(R) as a function of 
the number of reinforcements do not necessarily describe 
the behavior of a single individual. 

Since a given response (or set of responses) may have 
Several dimensions, some authors raise the problem of which 
of those dimensions can serve as a measure of learning. In 
some theoretical formulations, such as Hull’s, this is a criti- 
cal problem. Hull (1948a) adopted the position that all 
dimensions of a response are measures of the degree to which 
the response has been attached to new stimuli, since he wrote 
equations linking the various dimensions to reaction poten- 
tial. This position implies that dimensions of a response are 
always interrelated in the same way; but data on uncondi- 
tioned reflexes do not support such a position (Sherrington, 
1947), nor do data on human learning of “skilled” per- 
formances, where the subject must adjust the dimensions of 
a response to maximally effective values. Skinner (1950), 
therefore, has argued that many response dimensions, such 
as amplitude, are learnable as such and hence cannot serve 
as measures of learning, and concludes that probability of 
response is the only measure of learning. 

This argument leaves several alternatives open to Hull’s 
theory. The first is to ignore all dimensions but probability 
and retain reaction potential as a single final intervening 
variable. Another is to have separate reaction potentials for 
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separate response dimensions; each reaction potential for a 
given response would be computed in a different way. A thir a 
alternative would be to retain a single reaction potential for 
each response and to call responses differing in any eo 
different responses. The second and third alternatives woul 
still allow prediction of several dimensions of a response. 
Hull actually tried out the third alternative in his last work 
(Hull, 1952), where he developed a so-called “micromolar 


approach and treated responses of different amplitudes as 
separate responses. 
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areas of social science are not likely to be immediately af- 
fected. For each area the system of response definitions used 
will still depend heavily on what problems are being consid- 
ered. To take a trivial case, the economist studying buying 
practices will undoubtedly still ignore whether a consumer 
uses his left or right hand to extract his wallet. The total 
rung up by the clerk will still be the primary datum. The 
gaps between various social sciences may be due to the fact 
that unit responses for one discipline are aggregates of large 
numbers of response categories used by another. To the ex- 
tent that this is true, formal integration can be furthered 
by an explicit statement of the nature of such aggregations. 
The value of this procedure may lie primarily in clarifying 
differences between “level of analysis” of various disciplines. 


CONSISTENCY AND TRANSITIVITY OF BEHAVIOR 


In common with a number of matters thus far discussed, 
e.g. definition and measurement of response, response dimen- 
sions, quantification, ete., those of consistency and transitiv- 
ity have an important bearing upon the design of adequate 
observational techniques relevant to behavior theories. In a 
choice situation, two or more responses are available. Be- 
havior is consistent to the degree that the response chosen 
on one occasion is repeated on other occasions; transitivity 
means that if response R, is preferred to response R and 
R, to R, then R, is preferred to Rs. A discussion of these 
Concepts is particularly relevant to one major objective of 
this book, namely a consideration of the relations between 
Hullian theory and behavior science generally, for the fol- 
lowing two reasons: 

1. Let us consider the problem of measuring E (effective 
reaction potential) in terms of Hull’s approach. In certain 
experimental situations, usually designed to test hypotheses 
on learning, the investigator begins with a so-called “ex- 
perimentally naive organism.” Control of the experimental 
situation gives him data about the learning history of the 
organism between the time when prediction is made and the 
time when the predicted behavior should occur. He evaluates 
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these data in the light of principles of learning and deduces 
a measure of strength of tendency to perform. Useful as this 
method may be for certain purposes, it does not seem ap- 
propriate for many human behavioral problems. It is char- 
acteristic of these problems that the learning of the organism 
prior to the time of prediction is immense. In principle, if 
we had data on the past learning history of the organism, 
we could evaluate these data and thereby attempt to predict 
subsequent behavior. In practice, however, this method is 
often unusable, because the learning history of the organism 
is too lengthy and obscure to unscramble in this fashion. We 
need then some other way to determine the relevant values 
of È, at least for some initial time period. That is, given such 


echniques utilized to establish 
the values for variables in the theo 
with the implied answer, me Bld ie cone 
2. More generally speaking, 
to establish empirical eneralizati i i 
rect observations pon the beh Ae cn a Be 
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which purports to explain how the observed tendency to per- 
form came to have a particular value.) 

We may now set up our problem generally. Assume some 
stimulus situation which might evoke any one of the behav- 
ioral events R,, Ra, . . . Ry. Upon presentation of the stim- 
ulus, the probability that some R in the class will occur is 
unity. The occurrence of any R in the class precludes the 
occurrence of any other on that trial. The investigator at- 
tempts to predict which R will occur. This sort of problem is 
commonly termed “choice behavior.” 

In the analysis of certain behavior such problems are ap- 
proached by directly establishing empirical generalizations 
for the choice behavior in question. In order to facilitate sub- 
sequent discussion the analysis may be described in general 
terms as follows: ? 

The investigator defines (in terms of certain operations) 
a number sequence Fy, Es, . - - Ei, assigning the number 
Eı to the behavioral event Ri, and so on. He predicts that 
the R for which E is the greatest will occur.® A possible num- 
bering rule for specifying E,, Es, . . . È; in terms of R,, 
Rə, . . . Ri is this: The investigator presents the stimulus 
to the subject, who is constrained for purposes of observa- 
tion in such a way that only R, or Rs can occur. If R, does 
occur, our numbering rule is that È, is greater than Ey. 
Also, R, is said to be preferred to Rẹ (R,PRə) ; this is the 
operational definition of preference. The procedure con- 
tinues for other pairs until the number sequence Ej, Ês, . « - 


2. See Alchian (1953) for the following way of putting the matter—sub- 
stantively, not terminologically. These discussions refer particularly to the 
So-called “preference-system” analysis of consumer behavior, although we 
treat the matter more generally. Also see Samuelson (1947). 

8. This is the most general statement. The empirical significance of at- 
tempting to predict behavior on the basis of this postulate of course depends 
entirely upon the kind of observations from which the & values have been 
inferred. For example, in the case of the numbering rule suggested in the 
text immediately following, the significance of predicting with this postulate 
is evidently little more than that the subject will behave at the time 
the predicted behavior is expected to occur as he did at the time observations 
of that behavior were made. In preference-analysis terminology, call È, Èa 
+ +» È, the preference function, and any set of the R’s in Ry, Ra . . . R, the 
opportunity function. 


50 Behavior Theory and Social Science 
Èi has been specified. A simple example will illustrate the 
measurement procedure. Suppose that Ry, Rs, and R; are the 
only behavioral events possible. Observation reveals R,PRe 
and R,PR,. We specify E,, E., an B, as, say, 3, 2, and 1 
respectively. È is measured only up to a monotonic trans- 
formation. That is, any other number sequence, e.g. 9, 7, 5 
respectively, in which ranking is preserved, will do as well. 

When conceptualizing the measurement of È in this way, 
we assume that: 

1. The choice behavior in question is consistent in the usual 
sense. That is, if we find RPR., choice behavior is completely 
consistent, barring new learning, if the probability of a repe- 


tition of this event after another presentation of the stimulus 
1s unity. 


R; imply R,PR;. 
© restrictions has several conse- 
: woe al technique under discussion. If 
choice behavior is not consistent in the first sense, then we 
ed p+ + + Ei some sort of probabilistic inter- 
pretation.* Likewise, even if choice behavior is consistent in 
ot displ r 
niquely specify ¥,, Bp... Er Re 


: adigm, let us define the opportunity 
function as the subset of R’s in R, agi. a R. which the 
make. Suppose that observation reveals 


RPR, R.PR » and RPR.. 7 : 
values of E,, 5. and Bi. as 1: We could no longer specify 


ne there are 
egitimate assumption 


tendency with only a small random component, 
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that choice behavior is consistent and transitive, we could 
specify uniquely FE, E., Ey. on the basis of only nine paired 
comparisons.’ From then on we could predict R regardless of 
the opportunity function met in the future. But if choice be- 
havior is not transitive we would have to make observations 
on every subset of R’s in order to predict successfully which 
R of any subset would occur. 

In Hull’s analysis of choice behavior he postulated that 
that R will occur for which £ is the greatest. We might ob- 
serve R, PR, at one time and R,PR, at another because of a 
change in learning or in the conditions of performance; such 
changes are reflected in D, H, K, or I, in Hull’s terms, and are 
not relevant to the narrower problem of consistency discussed 
here. (In other commonly employed terminology, such 
changes would be said to be reflected in a change in “tastes.” ) 
Inconsistency may arise from behavioral oscillation (sOr) 
even when all other intervening variables are said to be con- 
stant ; we are concerned with this latter problem. 

The sOr postulate says that the value of Ê associated with 
any given value of È will be randomly distributed about the 
value of È. This postulate implies that some choice behavior 
will be inconsistent. Suppose that R, and Rs constitute the 
opportunity function. If p is the probability of the event 
R,PR,, then 1-p is the probability of the event R¿PR,. The 

5. This would happen only if we were fortunate enough to select the 
observational pairs in order of preference (Alchian, 1958). 

6. Data suggesting this postulate are these. If a group of subjects is run 
under conditions where all parameters of learning (i.e. of the subjects and 
the environment) known to be relevant are held constant, there is still some 
unexplained variance in the relation between performance and number of 
reinforced trials. Part of the variance is explained on grounds of individual 
differences between subjects; this cannot be eliminated by even the most 
careful selection of members comprising the group. Part of the variance, 
however, is held to be due to oscillation (sOr) on the part of each organism. 
It is postulated that even if one subject were run many times under condi- 
tions where learning status did not vary (i.e. where È retained its original 
value), there would still be some unexplained variance. One could, of course, 
question the legitimacy of “explaining” unexplained variance by postulating 
a random construct for the purpose. For the present, the issue of the legiti- 
macy of sOr doesn’t make much difference, since in the present state of 
development of the theory our predictions will be subject to some probabilistic 


interpretation. From the long-run point of view, the postulation of sOr really 
amounts to asserting that this will always be the case. 
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magnitude of p depends upon the relative levels of È; and Éz 
and upon the deviation of Ê on any trial due to sOr. If m 
had these latter values, we could calculate p- (In the specia 
case where È, equals E., we would expect p to equal .5 on 
the basis of this information alone.) In general, as E, grows 
larger relative to E,, R, becomes more probable and p can 
equal 1. Thus some choice behavior may be completely con- 


sistent. The Hullian formulation suggests that we cannot 
generalize about the consistency of choice behavior from 
information about a par 


ticular case of choice behavior. Each 
case may be different, 


The Hullian theory does imply that choice behavior is 
transitive,’ that is, the theor 


values is such that if È 
than È 


Suppose that adequate techniques reveal that p(RiPRe) 
was, say, .6. In this case Hull’s theory does imply that if 
P(R,) is greater than pP(R,) and P(R2) greater than p(Rs) 
then p(R,) is necessarily greater than pP(R;). But in such 
a case we can no longer p i i 


; this kind of predic- 
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greater than E,. But where the probabilities of competing 
responses are near .5, it is not very fruitful to treat the prob- 
lem in terms of an ordinal sequence È, E., . . . E, designed 
to predict the outcome of single trials. Rather, the theory 
suggests establishing a new number sequence G, which would 
be related to the old sequence. In the old sequence Ë; refers 
to R,, but in the new one G; refers to the proportion of times 
R, is made. Our numbering rule now says that if p(R,PR2) 
is .6, G, is .6 and Gz is .4.8 Unlike E,, G, is measured in a 
cardinal sense. This last point raises problems about applica- 
tion of the transitivity assumption to allow observational 
economy. If p(R,PR,) is .7 and p(R2PR;) .7, we can predict 
from Hull’s system the value of p(R,;PR;) if we know the 
standard deviations of Ê, Ê», and Ês. With an ordinal se- 
quence of E,’s, when we have information showing RPR», 
R2PR;, . . . RyPRio; we can immediately infer R,PRio 
without ever having made an observation on the pair R, and 
Ryo. In the case of a cardinal sequence, our information shows 
p(R,PR,), p(R2PR;), ..- p(RsPRio). Now, inferring 
P (RPR) would demand considerable calculation and con- 
siderable cumulative error. It might be easier to get that in- 
formation by direct observation upon the pair R, and Ryo. 

_ Finally, it should be pointed out that in the special case 
in which we had reason to believe that the choice behavior in 
question was very nearly consistent, we could proceed with 
the earlier numbering rule and utilize the transitivity postu- 
late to achieve any possible economy of observation. In this 
case our interpretation of Ey, Ey, . . « È, would be proba- 
bilistic only in the sense that our numbering rule involved 
some small random error. 

8. As we noted above, probability of response is often used as an index of 
strength of tendency to perform. This would seem to be inappropriate in 
choice situations. A statement about probability of response is, essentially, a 
statement about the joint frequency distribution of two (or more) tend- 


encies to perform. In consequence it does not seem an appropriate dimen- 
sion to measure the “strength” of any one tendency to perform. 


CHAPTER 4 


STIMULUS AND ANTECEDENT 
CONDITIONS 


O'= last chapter discussed attempts to define or cate- 


gorize responses, and some implications of those at- 

tempts for Hull’s theory. This chapter will treat the 
complementary problems of identifying and measuring ante- 
cedent conditions of behavior. Since the stimulus-response 
analysis proposes to predict behavior from a knowledge of 
antecedent events or conditions, we must consider how much 
and what kind of information seems necessary for a be- 
havioral approach to the social sciences. The usefulness of 
a stimulus-response analysis or of a theory like Hull’s de- 


pends partly on how easily the antecedent conditions which 
affect human behavior can be measured, 
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human behavior. This chapter js divided į 
entitled respectively “Stimulus Equivalence,” “Motivation,” 
and “History of Reinforcements.” Before proceeding to A 
detailed consideration of these topics, we shall indicate briefly 
why each seems important. 

Social scientists often stress man? 
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the capacities just mentioned. Human behavior varies with 
perception of similarities and differences in a wide variety 
of concrete situations; furthermore, this perception may 
change with experience in those situations. These latter fac- 
tors fall under the topic of stimulus equivalence, the first 
of the three we shall review. 

Motivation and history of reinforcements receive consider- 
able attention in anthropology, sociology, and psychiatry. 
Many theories of human behavior concern the origin, variety, 
and the action of human motives, and these theories deal 
with the effects of satisfaction or frustration of these mo- 
tives. In our terms these effects involve the history of rein- 
f orcements. Long debates over “rationality” and “irrational- 
ity,” “heredity” and “environment” often center around the 
subjects of motivation and reinforcement. Although insuf- 
ficient to arbitrate these contests, experimental data may be 
able to clarify them. Identification and measurement of moti- 
vation and the history of reinforcements are therefore criti- 
cal to social sciences and to a stimulus-response analysis of 
human behavior. 


STIMULUS EQUIVALENCE 


The immediate external environment facing an organism 
may vary in many respects from one occasion to another. 
Despite such variations the organism often makes the same 
response in different situations. This fact will decrease the 
difficulties of predicting behavior provided we know 1. the 
extent to which the present situation varies from past situa- 
tions, 2. the behavior of the organism in these previous situa- 
tions, and 3. the relations between the degree of similarity of 
Past to present situations and the probability of repetition of 
a previous response. The measurement of similarity between 
different environments, which is our first requirement, con- 
cerned experimental psychology from its very inception. 
This measurement always demands that any environment 
be resolved into stimulus elements or classes. For example, 
in a simple visual test we distinguish between the “radiant 
stimulus,” such as a flash of light, and the “rest of the envi- 
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ronment.” Beyond this it may involve stating quantitative 
differences between the “same” stimulus elements occurring 
in two different environments. On two different occasions we 
may assign different intensity measures to the radiant stimu- 
lus, and this assignment establishes a further classification. 
We find that, historically, psychologists and others have 
used three methods of defining or classifying stimuli. The 
first resembles apparatus-based definitions of responses and 
involves the use of physical instrumentation and a space- 
time framework for classifying stimuli. Much of classical 
psychophysics depends on physical terminology and measure- 
ments for specifying stimuli. In principle any environment 
could be treated exhaustively this way, but this rarely is 
done since usually it would be an extremely tedious proce- 
dure. Even in Psychophysics we often find exact measure- 
ments of the variable stimulus alone, and less precise state- 
ments regarding other “constant” aspects of the environ- 
ment. 
d for specifying stimuli is through the use 
l language. The expressions 
“loud noises” 


applied, particu- 
and replicability 
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physics and many behavioral studies of stimulus equivalence. 
Psychophysicists sometimes assume that the response system 
used by the subject is a one-to-one reflection of a “true” psy- 
chological scale or order of the stimuli. A similar assumption 
occurs in studies of generalization and equivalence. But both 
types of investigation may be designated “behavioral meth- 
ods” since they use some responses by a subject to aggregate 
stimulus elements defined by another method. The aggrega- 
tion may differ with the subject or response system utilized. 
Behavioral methods for aggregating stimuli therefore may 
depend somewhat on the subject’s past experience. In psy- 
chophysics this past history is controlled by using trained 
observers; but in the usual tests for equivalence of stimuli 
the investigator deliberately establishes a stimulus-response 
relation first and then systematically varies stimulus condi- 
tions. These latter tests provide some explicit information 
about the past history of the response system acting as an 
indicator, although the information is usually incomplete. 
Psychologists often have assumed that the subject’s past 
history influences stimulus generalization to only a minor 
degree. If this assumption is unjustified, however, behavioral 
methods of aggregating stimuli must be used in extending 
stimulus-response analysis to social phenomena, since these 
methods are sensitive to the subject’s past experience. And 
if this assumption is unjustified, the range of generality of 
many behavioral “laws” may be seriously reduced. Because 
of the possible importance of behavioral methods of specify- 
ing stimuli, we shall briefly examine some data from the 
former and their theoretical implications. 
_ Results obtained from studies of stimulus equivalence fall 
into two classes, those derived from single stimulus presenta- 
tions and those from simultaneous stimulus presentations. 
The single-presentation method yields two general findings. 
The first is that a response conditioned to one stimulus also 
tends to occur to stimuli which differ from it along some 
physical dimension such as intensity. The greater the differ- 
ence along such a dimension, the weaker is the tendency for 
the response to occur, a phenomenon called the “generaliza- 
tion gradient” (Hovland, 1937). The second general finding 
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is that a response conditioned to one stimulus composed of 
several elements also tends to occur to another stimulus 
complex containing some of those elements. The degree of 
this generalized response tendency becomes greater as the 
number of common elements increases (Hull, 1939, 1945). 
In the experiments just mentioned, the investigator must 
show that the response will not occur to the second or test 
stimulus without having been conditioned to the training 
stimulus; in other words, he must demonstrate that there is 
no pre-experimental tendency for the response to occur to 
the test stimulus. 

Given these controls, however, we may ask how a theory 
of behavior will predict the phenomenon of generalization 
between stimuli sharing common elements or those differing 
along some dimension. This is not so simple a problem as it 
might appear. It is insufficient to postulate that habits con- 
ditioned to one stimulus generalize to other stimuli in propor- 
tion to their similarity. The theory must specify this degree 
of similarity in advance, since exact prediction is impossible 
otherwise. With stimuli which are relatively easy to order 
physically or psychophysically, exact specification might be 
achieved by basing the theoretical constructs on empirical 
measurements of generalization. This procedure, however, re- 
stricts further predictions to the organism or class of organ- 
isms providing the initial data. And empirical generalization 
gradients are easily affected by differential reinforcement 
of responses to the stimuli on t 


3 he gradient. For some investi- 
gations, however, we may need only general statements such 


as “The less the difference in stimulus intensity, the greater 
will be the similarity between stimuli,” though occasionally 


“similarity” measured by generalization techniques is not 
even a monotonic function of physical difference between 
stimuli. 

When we turn to situations in which complex stimuli, such 
as other individuals, >, 


heorist is unable to order 
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of the theory. Some early work in this area, for example, 
studied how Negroes in Chicago rank each other as stimuli 
according to skin color (Warner, Junker, and Adams, 1941). 
Much work remains, however, before we can feel secure about 
application of any postulate on stimulus generalization. 

Similar problems arise from results obtained with the 
method of simultaneous stimulus presentation. In these 
studies the subject is presented with a pair of stimuli. Re- 
sponse to the positive stimulus is reinforced while response 
to the negative one is nonreinforced. This differential rein- 
forcement usually results in a discrimination where the re- 
Sponse occurs more frequently to the positive stimulus; in 
line with the simple generalization findings described first, 
this discrimination learning becomes easier as the similarity 
between the two stimuli decreases (Lashley, 1938). 

If the subject is presented with a new pair of stimuli fol- 
lowing this discrimination training, he may show consistent 
preference for one of the new stimuli. For example, if the 
original discrimination is between two squares differing in 
size, and the larger is positive, the subject tends to select 
the larger of an entirely new pair of squares. This phenome- 
non, which is called transposition (Ehrenfreund, 1952), 
raises a problem concerning the stimulus characteristics to 
which the organism responds. On one side is the absolute 
view that the subject learns to respond positively to the 
reinforced stimulus and not to respond to the nonreinforced 
stimulus; on the other side stands the relational view that 
the subject compares the two stimuli and responds to some 
abstracted feature such as “larger.” 

This problem must be settled experimentally but we can 
here mention only a few representative data. For the abso- 
lute view, Spence (1936, 1937) has shown that his theory 
of discrimination learning correctly predicts most transposi- 
tion phenomena obtained with stimuli varying along some 
single dimension such as size or brightness. He correctly 
predicts that sometimes transposition will not occur or its 
reverse will occur; i.e. selection of the smaller of test stimuli, 
whereas original training had reinforced the larger of a pair. 
These findings frequently embarrass the relational view. 
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Kliiver (1933), however, found that transposition may oc- 
cur to test stimuli which cannot be placed on any particular 
dimension with the training stimuli. For example, a subject 
black squares later may 
choose a large red circle rather than a small blue triangle. 
Kliiver’s use of the method of equivalent stimuli yielded many 
similar instances which favor the relational view. 
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clinical and experimental data (Grinker, 1951) show the 
importance of response-produced stimuli. Besides proprio- 
ceptive stimuli other types of stimulation following effector 
activity are also available. For example, we hear ourselves 
speak, feel ourselves sit down on a hard surface, or see our 
fingers operating more or less accurately on a piano key- 
board. Many nonproprioceptive stimuli are very important 
for determining further behavior. Thus any response of 
skeletal musculature produces marked changes in the stimuli 
confronting an organism. 

Theoretically all these response-produced cues can serve 
as stimuli for further responses. Such cues, which the in- 
vestigator does not directly observe, are often invoked to 
account for behavior which is otherwise difficult to explain. 
Response-produced cues and their role in behavior need fur- 
ther study before we can claim that new responses can be 
conditioned to all of them. Nevertheless these cues appear in 
some accounts of the phenomenon of acquired distinctiveness 
of cues. An example of this phenomenon comes from an ex- 
periment by Kurtz (1953), where subjects learned different 
motor responses to visual patterns more easily if they first 
had learned different verbal responses to the same stimuli. 
In this way it was found that attachment of one set of dis- 
criminatory responses to some stimuli can facilitate the sub- 
sequent attachment of an entirely different set of discrimi- 
natory responses to those stimuli.* Although three accounts 
are proposed for this fact, they are compatible with one 
another and all may be necessary to describe the empirical 
findings completely. 

Spence (1940), in explaining this phenomenon, has of- 
fered the notion of a receptor-orienting act, like fixation of 
the eyes. Stimuli initially may strike receptor organs in some 
inefficient fashion; for example, visual stimuli which the 
experimenter wishes the subject to discriminate may fall 
on the periphery of the retina. During the first stages of 


1. We shall not separately treat what is called the “acquired similarity” 
of cues. The reader should also be aware, however, that the learning of the 
same response to a pair of stimuli may retard a subsequent discrimination 
between those stimuli when a second response is necessary (Birge, 1941). 
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discrimination learning the subject may learn to orient his 
eyes and fixate the stimuli so as to provide optimal stimula- 
tion. This learning to orient receptors will facilitate subse- 
quent discriminations by insuring immediate optimal stimula- 
tion when new stimulus objects are presented. 

Dollard and Miller (1950, pp. 101-83), accept the re- 
ceptor-orienting theory but argue that a further basis for 
acquired distinctiveness occurs in some situations. Suppose 
the first discrimination involves the learning of different 
verbal responses, or any other responses which are compati- 
ble with those to be learned later to the two stimuli. Dollard 
and Miller say that these stimuli will acquire distinctive- 
ness, because on subsequent presentation the different verbal 
responses will occur and will provide response-produced cues. 
These cues presumably are different, and the total stimulus 


complex including them will be more distinctive. For exam- 
ple, two squares become more distin 


one “larger” and the other “smaller, 
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ple discriminations, such as those between patterns, some- 
how depend upon practice and are not inborn. 
_ The perceptual response is said to be modifiable by learn- 
ing, and acquisition of a discrimination between two stimuli 
also may involve acquiring perceptual responses which 
change the stimulus trace but not the proximal stimulus. 
Learning principles applicable to the perceptual response 
might duplicate those for instrumental response learning. 
Reinforcement of the perceptual response could be produced 
by reward for subsequent instrumental behavior. Perceptual 
learning, however, may follow unique principles, such as 
some suggested in the Gestalt school’s work (Köhler, 1947). 
Current emphasis on the role of learning in the phe- 
nomena, of stimulus equivalence also has produced theories, 
like Hebb’s (1949), which claim that relatively simple visual 
discriminations are learned. The general tenor of modern 
psychology stresses the subject’s past experience as a deter- 
minant of stimulus similarity. If these ideas are correct, 
behavioral methods for aggregating stimuli into classes of 
similar and dissimilar elements will become increasingly im- 
portant. And either the absolute approach to choice behavior 
or revised relational theories will be needed for general 
analysis of such behavior. Finally, such developments could 
produce dramatic changes in much psychological theory. 
These current trends may provide a stimulus-response analy- 
sis which is useful for a variety of problems in social science. 
We may note that some psychologists seem headed back to 
a position close to one held by a pioneer of experimental 


psychology, E. H. Weber (1846). 


MorivaTIONn 


So far we have concentrated on problems of measuring or 
specifying the immediate environmental conditions which 
confront the organism. Besides the external environment, 
a second set of conditions precedes and influences the likeli- 
hood of a response. These conditions are summed up in the 
term “motivation,” which has been the subject of heated dis- 
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cussion in the social sciences. Admittedly “motivation” 1s 
a vague term and there are no hard and fast lines between 
discussions of motivation and those concerned with stimulus 
conditions and reinforcement. Most references to motivation 
concern internal states or internal conditions imputed to 
organisms in an effort to explain many aspects of behavior. 
For predictive purposes, however, these internal states are 
usually referred back to some observable circumstances In 
the past which may have obtained over long periods of time 
and which are said to be the cause of the internal states. In 
a theory like Hulls, reinforcement is closely linked to moti- 
vation, and knowledge about motivation is necessary for the 
prediction of the future effects of a reinforcement. The rela- 
tions between reinforcement and motivation will be explored 
later in this chapter ; we shall now examine a concern of many 
social Scientists, the nature and number of motives. i 
Many scientists who deal broadly with human or animal 
behavior offer diverse lists of motives under such terms pa 
mpulses,” “needs,” and “urges.” 
ives or motives has inyolved three 
different criteria which ave been used loosely, and in com- 
, nvolves separating drives 
according to different terminal responses, such as drinking, 
orgasm, fighting, fleeing, ete. This criterion often produces 
ex post facto explanations of terminal behavior itself as the 
result of a postulated 


ated motive, and it tends to gloss over 
problems of predicting that behavior, Secondly, conditions 
of deprivation or stimulation, such as lack of food or water 


or presence of pain, provide a criterion which allows the 
prediction of future behavior by corre] 


with future responses, Finally, 
guished according to different g 
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rogating a subject. Thus separate motives can be determined 
before the subsequently predicted behavior occurs. 

Each of these three methods for differentiating motives 
has its own peculiar difficulties. The use of terminal behavior 
returns us to the problems of defining responses which were 
discussed in Chapter 3. Use of conditions of deprivation or 
stimulation presents the same problems discussed in the first 
part of this chapter. We will not repeat the points already 
made regarding these two criteria but will examine further the 
goal-objects criterion. 

The profit-maximization postulate as utilized in the con- 
ventional economic theory of the firm is an outstanding exam- 
ple of a motive defined by a goal object.* Given this postulate, 
we may at least formally use it in deducing a number of 
theorems about the economic behavior of the firm. (For 
example, we may deduce that, given certain cost functions, 
a firm will decrease its equilibrium rate of output in response 
to an increase in a per unit tax on its output.) The fact that 
the maximization type of motivation postulate at least puts 
definite restrictions on a theory in part accounts for its con- 
tinued popularity despite extensive criticism.* However, the 
conventional use of the profit-maximization postulate in de- 
scriptive economics amounts to an attempt to infer directly 
certain aspects of a subject’s problem-solving behavior from 
prestimed knowledge of the problem he confronts. Such an 
attempt is based upon an assumption in addition to that 
about the subject’s motivation. The additional assumption, 
usually neglected or implicit, is that the subject has learned 
the same route to the goal which the investigator deems cor- 


8. Some writers seem to view this postulate as being one directly upon 
economic behavior (i.e. that the firm does in point of fact maximize profit) 
rather than as one on motive (i.e. that the firm has profit maximization as a 
goal or objective). Most usage, however, treats it as a motivation postulate. 
This postulate has been the subject of much critical discussion in the litera- 
ture. In what follows, we make no attempt to review the discussion generally ; 
rather, we discuss only one aspect of this postulate. 

4. Many other goal-object motivation postulates do not shar 
portant formal property. This will be the case where there is no agreed-upon 
standard route to the goal postulated. There is such agreement in the case of 
maximization postulates, at least if the problem is sufficiently simplified (e.g. 
to rule out uncertainty, etc.). 


e this im- 
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rect. This last assumption cannot be demonstrated a priori, 
but it may be plausible when the sub ject and the investigator 
have a common learning history. . 
Motivational postulates play a different role in stimulus- 
response analysis than in economic theory and similar struc- 
tures. In the former, behavior is not inferred directly from 
statements about motivation. Such statements merely put 
broad conditions on the possible effectiveness of reinforcing 
stimuli, whatever the subject’s behavior may be. For exam- 
ple, food is an effective reinforcement for any behavior only 
when the subject has been deprived of it for some time. : 
Even within psychology, however, definitions of motives 
based on goal objects are easy to find. This type of definition 
produces a rapid proliferation of motives, since one can find 
innumerable goal objects. Concepts such as secondary rein- 
forcement and acquired drive tend to check this prolifera- 
tion. Secondary reinforcement implies that many stimuli be- 
come goal objects through temporal association with one or 
more “basic” goal obj ects, the latter being the only ones used 
to define different motives. The concept of acquired drive 
traces a subject’s attempts to obtain 
his previous learning, where, 
goal object was associated wi 
cept also states that fear, 
motive, is a response whi 
stimuli. Although these 
basic motives, they do no 
do they prevent reificati 


a ous accounts of 

ese accounts have been 
based on one or more of the three criteria for distinguishing 
this area has been the in- 
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consistency of these criteria. From the point of view of pre- 
dicting behavior, however, any theory of motivation must 
specify the conditions obtaining before actual performance 
which generate motivation. The effectiveness of a given re- 
inforcement depends on those conditions of deprivation or 
stimulation; the mere knowledge of the occurrence of rein- 
forcement is insufficient for predictions of certain aspects of 
behavior. This relationship between reinforcement and moti- 
vation encourages the separation of drives on the basis of 
goal objects or goal responses. And since this type of separa- 
tion rapidly yields an infinity of motives, social scientists, 
in order to make efficient predictions, are forced back to 
studying conditions prerequisite to the effectiveness of a re- 
inforcement. Thus problems of specifying motivation involve 
the idea of reinforcement, which we shall discuss next. 


REINFORCEMENT 


The law of effect has long been recognized, and Thorn- 
dike’s statement introducing it into the social sciences is only 
one of its many formulations. Briefly this law says that when 
certain events (reinforcements) follow a response, the like- 
lihood of that response in similar circumstances increases ; 
when other events (nonreinforcements) follow the response, 
its likelihood of repetition decreases. If we could identify re- 
inforcers and nonreinforcers and trace their effects on further 
behavior, we obviously would have a powerful tool for pre- 
dicting behavior. Our previous discussion of motivation leads 
to the consideration of some implications of reinforcement 
for the analysis of human behavior. But before treating the 
effects of a sequence of reinforcements and nonreinforce- 
ments we shall deal with operational and theoretical prob- 
lems of identifying a reinforcement. 

Spence (in Stone, 1951) points out that three types of no- 
tions are involved in identifying a reinforcement: 1. the em- 
pirical law of effect, which says that certain stimuli such as 
food or water, under certain conditions of deprivation, will 
increase the probability of any response which they follow; 
2. a general statement of the presumed effects of reinforce- 
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ment; and 3. specific summary statements as to the exact 
reinforcement. Under the second type come statements such 
as “reinforcement increases the strength of an S-R connec- 
tion,” while statements under the third type specify rein- 
forcement as drive-reduction (Dollard and Miller, 1950, p- 
40) or goal response Rg. Obviously one can accept statements 
under the first type of notion without commitment to a par- 
ticular position under the other two. An operational defini- 
tion, such as the first, is obviously necessary for predicting 
behavior from data on reinforcement. The other two treat- 
ments of reinforcement initially rely on the operational one 
and suggest particular kinds of processes which follow the 
presentation of a reinforcing stimulus. 

Identification of reinf. 


empirical discovery of stimuli whi 


cing properties beyond the 
observations, or 2. the loss 


is plausible, since the social hase 
stable reinforcers of high effect; avior demands 
fulness. Ethnographic materia] 
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information about reinforcers and may lessen the necessity 
for prolonged study of a single individual. 

The definition of a reinforcing stimulus as one which in- 
creases the probability of response which it follows cate- 
gorizes all stimuli as reinforcers or nonreinforcers. The 
classification of any stimulus may vary for an individual or 
a group over time, since secondary reinforcers may be de- 
veloped or extinguished. It will also vary between different 
sets of people. Furthermore, within these limitations one 
must decide on how to treat punishment. 

Punishing stimuli are defined usually as those which an 
organism avoids or will learn to avoid by making a response 
that eliminates the stimuli. This definition tells us about 
responses that follow the punishing stimulus. Our definition 
of reinforcement, however, concerns responses which precede 
a stimulus. If we try to define punishment in terms of effects 
on preceding responses, we find that punishment may either 
Increase or decrease the probability of a response. When the 
response which follows punishment is the same as that which 
precedes it, punishment will increase the probability of the 
latter (Logan, 1951; Muenzinger and Powloski, 1951). If 
the responses preceding and following punishment are differ- 
ent, many experiments show that punishment decreases the 
probability of the response prior to punishing stimuli. There 
is no one-to-one correspondence between nonreinforcement 
on the one hand and punishment on the other, if we take the 
definitions stated above. The best solution seems to be that 
of accepting the reinforcement-nonreinforcement dichotomy, 
and classifying punishing stimuli one way or the other in 
terms of effects in specific situations. The complex relations 
between reinforcement and punishment flow from their defini- 
tions on two separate criteria. 

The results which show that punishment may increase the 
probability of response raise problems for any theory, in- 
cluding Hull’s, which identifies reinforcement in terms of an 
increase in response probability. A theoretical position which 
seems to handle these results and which has few postulates 
can be found. This position states that only two consequences 
affect reaction tendency: reinforcement and nonreinforce- 
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ment. Reinforcement acts to increase, and nonreinforcement 
to decrease, the tendency to repeat a response to a stimulus 
complex. Punishment would have no direct effect on the pun- 
ished response tendency but would act indirectly on Behavior 
via the responses which it evokes and which are reinforce 
by its termination. . i 
According to this description, termination of punishmen 
is reinforcing. Therefore, any response which immediately 
precedes this reinforcement will obtain an increased reaction 
tendency. Many experiments show that a response which oc- 
curs regularly to some stimulus embedded in a series 0” 
stimuli tends to become anticipatory and to occur to stimuli 
earlier in the series. This law, which should be deducible from 
a theory like Hull’s, implies that responses evoked by punish- 


ment prior to its termination later will occur before the pun- 
ishment. 


The effect of punishment u 
fore depends upon the nature 
by punishment. If these 
incompatible with the P 


pon a preceding response there- 
of the responses evoked in turn 
punishment-produced responses are 
unished responses, then the former 
will become anticipatory and will reduce or eliminate the oc- 
currence of punished responses through competition. But if 


the punishment evokes responses which are identical or com- 
patible with the punished 


before he can venture a prediction. 
This requirement even 


» 1948) where shock evokes running 
ing still but evokes cessation of 


"unning. The second case appears 
(Muenzinger and Powloski, 1951) where shock initially 
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evokes withdrawal from a charged grid but evokes rapid for- 
ward movement after a few trials. 

In dealing with human social behavior these two problems 
are further accentuated. Many punishments imposed upon 
an individual by his fellows are not physically painful but 
rather involve learned fears. The effectiveness of these sec- 
ondary punishments (e.g. social disapproval) therefore will 
depend upon the past history of the individual. The identifi- 
cation of such stimuli involves the same difficulties as those 
met in dealing with secondary reinforcers, once we recognize 
how markedly both types depend on learning. 

So far we have not considered the quantitative aspects of 
reinforcement and their effects on behavior. We have treated 
reinforcement and nonreinforcement in an all-or-none fash- 
lon. But a reinforcing stimulus may vary in its quantitative 
Properties, and these variations affect behavior. Despite the 
long history of the law of effect, many quantitative relations 

asic to its operation have not been studied empirically. 
Nonetheless we find enough data to present a general frame- 
work for the analysis of those relations. This analysis will 
complete the first part of our discussion of reinforcement. 

A reinforcing stimulus has a number of measurable aspects 
Such as magnitude, time of occurrence after a response, and 
sheer occurrence or nonoccurrence after each of a sequence 
of responses. Also, as we pointed out in Chapter 3, a response 

‘as Several measurable dimensions. Now we will define condi- 
tions of reinforcement as the relationships in a specific situa- 
tion between each aspect of a reinforcing stimulus and each 
dimension of a response. These relationships are determined 

y an experimenter in the laboratory; in nonlaboratory 
Situations they describe environmental constraints placed on 
a subject’s behavior. These functions may be of any single- 
valued form; different situations will present different condi- 
tions of reinforcement, each of which tells how a given aspect 
of reinforcement changes as a certain response dimension 
varies.” By way of illustration let us describe a possible 
laboratory situation. 


5. There are certain limitations imposed by the necessity for the conditions 
of reinforcement to be internally consistent. For example, magnitude and de- 
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In a certain experiment response amplitude may be Ter 
lated to magnitude of reinforcement by some monotonic n 
creasing function; i.e. as amplitude is increased, a greater 
reward is offered. Simultaneously, amplitude may bear 4 
horizontal relationship to delay of reinforcement: the delay 
is some constant value regardless of response amplitude. 
Further, latency of response may be related directly to delay 
of reinforcement, so that shorter latencies provide shorter de- 
lays. Under such a partial set of conditions of reinforcement 
the subject can increase magnitude and reduce delay of re- 
inforcement by faster and larger responses. The degree of 
such improvement, of course, depends upon the slopes of the 
functions described above. 

The number of possible conditions are too numerous to 
itemize here but the examples given suggest the implications 
of the concept of conditions of reinforcement. This concept 
complements Hull’s identification of behaviors differing 
along some dimension as different micromolar responses. The 
organism may be viewed as choosing values for various di- 
mensions of his behavior, and the conditions of reinforcement 


describe what he gets for any particular selection. This view 
suggests further studies 


under a variety of condi 
may then fit a quantitati 
as disutility as a speci 
sions, and utility as a s 
inforcement. This ty 


lay of reinforcement are independent except at zero magnitud here delay 
aa e A a AE SE tae’ delay is au- 
tomatically determined. A complete analysis of the restrictions is not neces- 
sary for the purpose here at hand. 
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sions of the response and aspects of reinforcement were not 
provided. A catalogue of response dimensions depends on 
what system is used for defining responses as well as on other 
factors, a point discussed in Chapter 3. We shall now men- 
tion some of the aspects of reinforcement which appear to be 
Important determinants of behavior. 

“Magnitude” of reinforcement refers to the amount of the 

goal object; behavior may vary with this magnitude and may 
change with any shifts in magnitude (Zeaman, 1949). The 
“delay” of reinforcement is the time elapsing between the 
termination of the response and the receipt of the reinforce- 
ment; behavior also varies with this delay and changes with 
any shift in the delay (Logan, 1952). We may expand the 
time aspects of reinforcement by defining the “latency” of 
reinforcement as the time between the initiation of the re- 
Sponse and the receipt of the reinforcement ; and the “‘inter- 
val” of reinforcement may be defined as the time between 
Presentation of a conditioned stimulus and the receipt of the 
reinforcement. To our knowledge, neither of these latter two 
aspects has been studied empirically; they are suggested as 
Systematic possibilities. : 
_ Other aspects of reinforcement have been studied, includ- 
ing “quality” of reinforcement; subjects prefer one or the 
other of two goal objects of equal weight (F. Sheffield and 
Roby, 1950). Another aspect is the “form” of the reward; 
several pieces of food produce stronger behavior than a single 
piece of the same total weight (Wolfe and Kaplon, 1941). 
Finally, there is the “pattern” of reinforcement: the prob- 
ability that reward will follow a particular occurrence of the 
response, and the pattern of reinforcements generated by 
Interspersed nonreinforcement. We shall discuss this condi- 
tion below. 

Each of these aspects of reinforcement—and perhaps 
others—is related to each dimension of the response. The 
Conditions of reinforcement depict what may be called the 

terms” confronting the organism: the range of response 
dimensions available to him and the levels of the reinforce- 
ment aspects contingent upon any particular selection. 

When we come to the pattern or schedule of reinforcement, 
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we meet the central problem in tracing the effects of previous 
reinforcements on behavior. This problem concerns the ef- 
fects of a temporal sequence of reinforcements and nonrein- 
forcements on one or more dimensions of a response. Hull’s 
formulation of habit strength as a function of number of re- 
inforcements assumed at first that reinforcement occurs at 
every opportunity; he assumed that during learning a re- 
inforcement is never followed by a nonreinforcement. Like- 
wise, his formulation of conditioned inhibition as a function 
of nonreinforced trials made a similar assumption regarding 
the pattern of nonreinforcement. These two assumptions of 
a regular schedule of reinforcement or nonreinforcement re- 
spectively cover restricted cases, and Hull’s formulation faces 
difficulties which we shall discuss shortly. 

Obviously an organism may be reinforced on some occa- 
sions and not on others according to a pattern imposed by 
the investigator. Experimental psychologists have studied 
many cases of partial reinforcement. (See Skinner, 1938, 


and F. Sheffield, 1948, among others.) Conditions in human 


society practically guarantee that partial reinforcement pre- 


vails for many kinds of social behavior. It may affect differ- 
ent dimensions of a response in quite diverse ways. Rate of 
response and resistance to extinction generally are enhanced 
by partial, as against regular, reinforcement. But amplitude 
or probability within a group of subjects may be affected 
primarily by the number of reinforcements and nonrein- 
forcements within widely varying patterns. Certainly, the 
empirical laws of partial reinforcement are relevant to many 
human situations where some dimensions of behavior are 
maintained over long periods of time, although others may 
change. As with many other conditions of reinforcement, we 
do not have a complete set of such laws. 

A series of regular reinforcements followed by a series of 
regular nonreinforcements is a Special pattern of reinforce- 
ment. This particular pattern, however, has been studied 
very frequently; during reinforcement a habit is built up 
and during nonreinforcement it declines. The extinction or 
disappearance of a habit under nonreinforcement provides 
one model for the phenomena of forgetting, which have re- 
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ceived wide attention in psychology and psychiatry. Before 
taking up some theoretical implications of patterns of rein- 
forcement we shall briefly discuss forgetting, in order to 
emphasize the fact that pattern of reinforcement is probably 
not the sole determinant of the loss of a habit. 

From the point of view of reinforcement theory, we as- 
sume initially that forgetting is not a passive process, due 
solely to the lapse of time since learning. Considerable evi- 
dence supports the view that forgetting depends on inter- 
ference between new and old responses (Woodworth, 1938, 
Pp. 257-76; Hovland, in Stevens, 1950; McGeoch, 1942) ; 
the theory that forgetting is a passive process seems unneces- 
Sary. But behavior patterns may be lost through any of 
three possible processes. 

_ One process is the development of new responses which are 
Incompatible with older ones, even though the latter are still 
reinforced. The new responses become strong enough to pre- 
vent performance of the older ones. A given response thus 

Isappears when another, incompatible with it, has been at- 
tached to the cue for the first. This process is held to be a 
Paradigm for repression (Dollard and Miller, 1951) al- 
though in most cases of repression a large number of con- 

cting response tendencies may be involved (Freud, 1938). 

The second process through which behavior patterns are 
lost involves a decrease in the probability of a learned re- 
Sponse as a result of repetition with lack of reinforcement. 
Th this case apparently nothing new is learned ; the organism 
may return to other responses which it made before the ex- 
tinguished habit was originally established. The conditioning 
of any new response to a cue involves the extinction of other 
responses already attached to that cue. a 

Finally, the third process by which the probability of a 
response can be decreased should be mentioned even though 
the decrease is merely temporary. This process has been 
called “fatigue” by Sherrington (1947, pp. 215-24), who 
found that repeated evocation of a reflex at a sufficiently 
high rate decreased the amplitude or rate of response. If the 
subject was not stimulated for a short period afterwards, the 
reflex recovered from fatigue and returned to its usual status. 
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This process, and several others allied to it, may be involved 
in many changes of behavior. N 

Hull’s concept of reactive inhibition is similar to the idea 
of fatigue (1951, pp. 73-86). Objectively, we say fatigue 
has occurred when a response declines in strength merely be- 
cause of frequent elicitation. Responses also may decline in 
strength because of extinction, and it is possible but not al- 
ways easy to separate the effects of extinction from those of 
fatigue. This separation can be made, however, when we deal 
with unconditioned responses, since the response strength at 
the beginning of separate experimental sessions on different 
days is the same. Fatigue of an unconditioned response 18 @ 
function of many factors, and the general assumption that 
fatigue is a monotonic increasing function of the number of 
stimulus presentations is not necessarily true either (Lloyd, 
1949). The stimulus rate can be adjusted to prevent fatigue 
and under certain conditions response strength may increase 
with repeated stimulus applications. 

In his theory of behavior, Hull (1951, pp. 73-92) ex- 
plains extinction of responses through lack of reinforcement 
itioned inhibition, which is op- 
th; the latter is built up by re- 
ases. Furthermore, like habit 


e slower acquisiti f more ef- 
fortful responses. The notio OROA o 
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ung experiments, 
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1 a response is condi- 
1 another incom 


F patible response has 
already been attached. This technique produces d appen 
ance of the response initially attached to 


` the cue, even though 
that response is never evoked during the countercondition- 
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ing. The old response, which now does not occur, does not 
show spontaneous recovery, but it can be reinstated when 
the new response is extinguished. As mentioned previously, 
counterconditioning may provide a paradigm for repression, 
in which the repressed habit does not spontaneously return 
merely through lapse of time. The phenomena of repression 
and hypnosis provide convincing reasons for assuming that 
forgetting is not due to lapse of time alone. Freud, however, 
seemed to recognize two types of forgetting: repression and 
assimilation. The latter type is akin to retroactive inhibition, 
which also has been treated in part as a counterconditioning 
Phenomenon. Unfortunately, an adequate account of the 
various modes of forgetting is not yet available, and further 
work must be done on this problem. 

We now return to the implications of phenomena de- 
Pendent on patterns of reinforcement for Hull’s theory. 
Actually these same implications hold for many theories 
which describe learning as the net effect of two opposed proc- 
esses, one positive and the other inhibitory. We will consider 
only the pattern of reinforcement where there are alternating 
blocks of regular reinforcements and nonreinforcements. 

We have previously discussed two general behavioral laws: 
lL if a reinforcing state of affairs closely follows the occur- 
rence of a response, the probability of repetition of that re- 
Sponse to the stimulus complex present is increased; and 2. 
the failure of a reinforcing state of affairs (nonreinforce- 
ment) is followed by a reduced response probability. We now 
consider a temporal extension of these two laws: 3. if a re- 
inforcing state of affairs is reinstated after a phase of non- 
reinforcement, response probability is again increased. It is 
generally reported that this relearning proceeds more rap- 
idly than original learning. > 

An adequate theory of behavior must explain the phenome- 
non of relearning and this requirement raises & number of 
Problems. The manner in which any system handles relearn- 


6. A i ose initially to work only with original learning data; 
any aN, is applicable to a specifically demarcated class of 
events. Hull’s original system was so restricted, It is the writers opinion, 
however, that even early postulates should offer at least qualitative descrip- 
tion of all the known general laws in the relevant area. 
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ing is partially dependent upon its treatment of sia es 
learning and extinction ; within the formulations of stimulu a 
response theory the role of nonreinforcement is the pi 
critical determinant, because original learning is deseri T 
as the acquisition of a hypothetical bond or connection be 
tween stimulus and response (which we may call a habit). 
Relearning phenomena require that the postulated effects o 
nonreinforcement be counteracted. fy 
There are in general two alternative assumptions concern- 
ing the effects of nonreinforcement: a reduction in the anny 
nally learned habit, or the accumulation of a second habi 
(typically called inhibition) which subtracts from the first. 
If a theorist selects the first position, then the relearning 
phenomenon forces him to admit a subsequent increase 10 
the habit when reinforcement is reintroduced. Theories © 
the second type must permit a subsequent reduction in in- 
hibition upon reintroduction of reinforcement or postulate 
nd phase of reinforcement. 
involves an infinite progression 


of acquisit its, we shall tentatively re- 


ject it as impracticable. 
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may increase the probability of a re- 
0, whereas after complete learning an 
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thereby directly accounting for faster relearning. However, 
a second relearning after a second extinction may proceed 
even more rapidly than the first relearning, and the theorist 
must therefore relate rate of inhibition dissipation to the 
number of preceding nonreinforcement phases. Accordingly, 
neither position on nonreinforcement presents much hope for 
parsimony. 

These arguments strongly suggest that in each function 
for habit growth or decay any parameters which determine 
rate of approach to asymptote must be partially dependent 
upon the previous history of reinforcement and nonreinforce- 
ment. It is an oversimplification, however, to assume that a 
Straight count of such reinforcement-nonreinforcement 
Phases will be a satisfactory independent variable. The work 
on partial reinforcement clearly shows that the pattern of 
these phases is also relevant: irregularly interspersing fifty 
Nonreinforcements among fifty reinforcements does not pro- 
duce the same effect of rapid relearning as an identical num- 
ber of phases where each phase is carried to asymptotic per- 
formance. A great amount of systematic data is therefore 
required before an intervening-variable theory can be built 
which adequately handles the relearning phenomena. 

While the discussion above has concentrated upon relearn- 
Ing, a parallel set of statements could be made concerning 
re-extinction, which may progress at a different rate than 
that of original extinction. It is particularly complex when 
One recalls that the introduction of reinforcement-nonrein- 
forcement phases in the partial-reinforcement studies ap- 
Pears to produce greater resistance to extinction (slower ac- 
cumulation of inhibition or decrease in habit). The need for 
Systematic study is again apparent. 

We might, at the present time, suggest one further com- 
plication, If some rates of growth or decay are made de- 
Pendent upon the number and pattern of preceding rein- 
foreement-nonreinforcement phases, it may be useful to as- 
sume that these rate changes generalize upon learning and 
extinction of similar habits. Such a position would be sug- 
gested by the work of Harlow (1950) on “learning sets.” 

The primary importance of keeping relearning in mind 
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when the nonreinforcement postulate is constructed is to 
avoid the impasse present in Hull’s last version of his theory: 
He held an inhibition theory of extinction but attempted to 
deduce this inhibition as a competing not-responding habit. 
Because of the permanence he elsewhere ascribed to habits, 
his system implies that a response once fully learned and 
fully extinguished can never be relearned. If, however, in- 
hibition is postulated rather than deduced, it need not have 


the properties which for other reasons the theorist may wish 
to ascribe to habits. 


The behavioral effects of patterns of reinforcement thus 


na which create several problems for @ 
theory like Hull’s, Anticipating these problems may help 1m 
a revision of his theory or the development of a new one. Even 
without a satisfactory theoretical system, however, the em- 
Pirical laws of partial reinforcement can aid the analysis of 
Some aspects of human behavior. Linguistic behavior, for 
tained somewhat by irregular patterns 
» and may help maintain other behavior 
ial reinforcement for the latter. Certain 


CHAPTER 5 


LANGUAGE 


nition among philosophers, linguists, anthropolo- 
gists, psychologists, and sociologists that the exist- 
ence of culture rests indispensably upon the development in 
early man of the faculty for symbolizing, generalizing, and 
Or eae substitution” (Kroeber and Kluckhohn, 1952, 

By language we mean a system of conventional vocal signs 
used by interacting members of human communities, not 
Written representations of such systems. Writing is an in- 
teresting and powerful culture complex in its own right and 
18 not devoid of influence on language, but we exclude its 
consideration here in the interests of simplicity of exposition 
and because the possibility of an analogous treatment of it 
should be obvious. 

Language is probably the earliest learned of the cultural 
systems (Hockett, 1950), and, as has been often noted 
(White, 1940), plays a predominating role in the learning 
of nonlinguistic culture. For this reason it seems likely that 

e theoretical gap between infrahuman and human behavior 
can best be closed by a consideration of the linguistic aspects 
of culture. It by no means follows from this that analysis 
of the rest of culture only awaits the application of tech- 
Niques analogous to those of linguistics, as some investigators 
Seem to suggest (Hall and Trager, 1953). We shall there- 


fore confine ourselves to the consideration of the role of lan- 


guage in human social affairs, taking for granted the results 


of linguistic analysis. For our purposes it would not seem 
to make any major difference whether the analysis is made 
in terms of the theory of Hj elmslev (1943), Jakobson, Fant, 
and Halle (1952), Harris (1951), or Bloch (1948, 1950), 
so long as one is chosen and iie implications faced. We have 


“C ERTAINLY there is, as of 1951, a wide recog- 
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found it convenient to use the Trager-Smith (1951) analy: = 
of English, with modifications designed to bring our descrip 
tion into harmony with Bloch’s postulates. . 

Before undertaking a general discussion of the topic we 
shall consider briefly a special use to which language has been 
put, namely as a research tool in social science. 


Resrarcu Users or VERBAL REPORTS 


Social scientists have made wide use of verbal responses 
in an attempt to predict behavior. The utility of this tech- 
nique is limited, however, by the fact that “obvious” rela- 
tions between word and predicted deed are not always borne 


out. LaPiere demonstrated this twenty years ago when he 
found that hotel and restauran 


atively to a written question as to 
d accept Chinese clientele.? Since that time 


question-answer sequences whic 
predicting particular behavior, 
principles have yet been develo 
the relation between such responses and a given kind of be- 
havior. 

It is possible that a theory will help in the development 


of general principles governing the use of verbal or “test” 
responses. Though the Hullian theory is not adequate to this 
task it may help clarify 


Several issue fronti olling 
and attitudinal studies (see Doob, 1947) eon ronting p 


Polling techniques are usually designed to predict some 
specific behavior by eliciting from the subject a verbal report 
as to which of alternative responses he would be likely to per- 
form in a given situation, 


7 . In pre-election polls, for example, 
the potential voter is ty pically asked: If the election were 

1. Including modifications ENTER of ee aes fat al 
Trager-Smith “junctures” except “plug juncture” are wllomatic Ss ates of 


ment, but not as phonemes 


dividuals whose behavior was observed (LaPiere, 1934, 1938), 
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held today, for whom would you vote? It is assumed that 
when the election occurs the subject will behave in the man- 
ner indicated by his verbal response; i.e. he will vote for the 
man whose name he states. Often this is justified, but in order 
to be able to specify the circumstances in which it is it would 
be useful to know why people sometimes do behave as they say 
they will. One might assume that there is some equivalence 
between verbal test responses and the behavior to be pre- 
dicted. If the test stimuli are sufficiently similar to the stimuli 
which evoke the predicted behavior, then equivalent re- 
Sponses may be evoked by generalization. 

If this is the process by which correspondence comes about, 
several factors may interfere with it. Stimuli may differ suf- 
ficiently in the test and predicted situations so that different 
reaction potentials are evoked. Testers seeking to secure 
maximum correspondence might well try to make the stimuli 
in the two situations as equivalent as possible. A second 
source of noncorrespondence may be found in changes in re- 
sponse tendency which occur during the period between test- 
mg and prediction. An effort has been made to test for rigid- 
ity of tendency (Mosteller et al., 1949), presumably in an 
attempt to select those individuals least likely to be influenced 

y changes during the interim period. Until we have some idea 
of the kinds of learning experiences which intervene, how- 
ever, it will be difficult to deal with this problem systemati- 
cally. For some kinds of behavior, minimization of the inter- 
Vening time period might be expected to provide a partial 
Solution for the problem, although the utility of the resultant 
short-range predictions might well be limited. Still another 
difficulty is suggested by Hull’s concept of behavioral oscilla- 
tion (see our discussion in Chapter 3). 

It should also be noted that the test itself might act as a 
nus become a source of noncorre- 
Spondence against which limitation of the interim period 
could not avail. The effects of test experience could be elimi- 
nated by predicting from the test the behavior of untested 
persons. Like any sampling, this requires that the tested and 
observed individuals be similar in regard to membership in 
any sets which significantly affect the behavior in question. 


earning experience and tl 
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As our discussion in Chapter 7 will suggest, more sets may be 
important in this connection than such commonly used ones 
as those defined by age, sex, and social class. 

A special reason for dissimilarity between tested and ob- 
served subjects occurs when one or both sets are self-selected. 
The act of joining a sample may indicate characteristics 
which also affect the behavior predicted. Thus, Kinsey’s first 
sample was criticized as atypical of the universe of adult 
American males because interviewees who selected themselves 
might be presumed to have had high anxiety or a need for 
catharsis in regard to sexual matters (Wallen, 1949). Kinsey 
has since sought to limit self-selection by obtaining 100 per 
cent samples of various pre-existing organizations. The re- 
verse of this problem arises when prediction is attempted 
concerning a universe whose members select themselves. In 
the prediction of voting, for example, it has been necessary 
to try, on the basis of polling, to predict not only what people 
so who will get there. 
also been used by attitude testers 
than one kind of behavior. Testers 


than the polling technique. 
Thus far, attitude testers have c 


trat the im- 
portant problem of reliability. They ee 


can be used to assign indi 
class or rank order.? Reliability 


: ty.* We still know very little 
about the relation between reliably descri z d 
the kinds of behavior which anes Sette ee ae 


8. For a discussion of two recent techni 

ture analysis, see Stouffer et al, (1950). oS 
4. For a discussion of this distinctio 

ate n see McNemar (1946), 


Scalogram and latent struc- 


especially pp- 
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attitude-testing techniques as predictive instruments might 
be greatly enhanced if they were fitted into a theory as in- 
dependent variables. 

It is possible that the techniques for the reliable reporting 
of attitudes might be applied to the estimation of some of the 
variables suggested by Hull’s theory. If a reliable measure 
of drive could be secured from verbal responses, for exam- 
ple, the relation of this measure to particular behavior would 
be indicated by the theory. In this way validity of the meas- 
ure could be tested. From the viewpoint of the theorist such 
techniques might have extreme value. For certain types of 
research this method could constitute the most economical if 
not the only way of obtaining information on drive, initial 
hierarchy, and reward anticipation. Once validated by cor- 
relation with the prior conditions presumed to give rise to 
these intervening variables, verbal responses might be con- 
fidently used as convenient measures of them. Some attempts 
along these lines have been made (e.g. Taylor, 1951). 

In addition to its use as a device for estimating certain be- 
navioral parameters, language constitutes interesting and 
™Mportant behavior in its own right. We therefore turn to the 
Subject of the development of language in the individual and 
its influence on his other behavior. 


LANGUAGE LEARNING 


Language seems to be acquired in accordance with the 
Principles of learning which apply to other behavior (Leo- 
bold, 1937-49; McCarthy, 1946; Jakobson, 1941). Vocal 
activity in the form of crying appears to be very high in 
the hierarchy of responses at birth. During the first months 
of his life the child makes responses connected with inges- 
tion and respiration which are primary functions of the vocal 
organs. When the various movements of the lips and tongue 
are combined with ordinary respiration or with voiced 
respiration, the child produces noises that sometimes sound 
like elements of some language. These responses are now sub- 
Ject to the action of reinforcing stimuli from other human 
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beings, ranging from the appearance and increased ee 
tions of the mother following the child’s crying to the interes 

of attentive elders as the child appears to smile or happens 
to emit a sound or sequence taken to be like that of eon 
language. The stimuli which we summarize as “presence Hi 

increased attentiveness” of some older human being already 
have very great secondary reinforcing properties, since they 


are often paired with feeding, relief from discomfort, and 
other desired attentions. 


The older members of the s 
force responses of the child’ 
frequently as these respon. 
the production of the sou 


peech community tend to oe 
s vocal organs more strongly an : 
Ses approach those necessary for 
nds of the language. So also for 
the morphemes of the language; if the infant produces a S 
quence of sounds that is similar to a taboo word of the lan 
guage, it is not reinforced, but when he first says something 


that sounds like “mama” (or its equivalent) it is strongly 
reinforced. 


At about 
sounds just spok 


aa co ene anid direction of his deria 
tions from the linguistic system, 
It is probably too early to attem 


5. For example, “mama” gets re: 
not as a replication of “papa,” et, 


pt to state anything about 


inforced as a replication of “mama,” but 


C, 
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the order in which particular phonemic and morphemic ele- 
ments enter the hierarchy and are differentiated or combined 
M successive approximations to the adult phonemic system. 
The studies that are phonetically and phonemically accurate 
are of insufficient generality, and those which have employed 
larger samples do not inspire confidence in their phonological 
Sophistication. All studies suffer from the overwhelming pre- 
Ponderance of subjects from Indo-European speech com- 
munities. The few exceptions are listed in Jakobson (1941) 
and Leopold (1952). 


LANGUAGE as a DETERMINANT OF BEHAVIOR 


Once the general system of language (though not all the 
elements) is acquired by about the age of six, the great im- 
Portance of its role in human behavior may be seen equally 
in the learning of all subsequent culture, both linguistic and 
nonlinguistic, and in the difficulty experienced by humans 
Mm solving problems where significant linguistic cues are not 
available (“repressed” or “unconscious”). 

In the main, elaborate theory construction is probably pre- 
mature in this area, which needs empirical study of many 
little known variables. Nevertheless at least some brief indica- 
tion of the kinds of analytical processes implied by an S-R- 
type approach to this problem may be of interest. There 
Seems to be some agreement that the great importance of 
language in human behavior lies in its cue values. Any ut- 

€rance serves as a series of stimuli both to the speaker him- 

Self and to others. There would be an initial presumption 
that such stimuli can serve the same functions in the learning 
Process as stimuli generally. In what immediately follows we 
shall note certain of these functions which have received at- 
tention in the literature. Subsequently we shall be concerned 
Primarily with the problems facing investigations of lin- 
guistic behavior as it is involved in individual behavioral 
Situations such as problem solving. The solution of such prob- 
lems should contribute also to the knowledge necessary to 
make predictions regarding groups. 

An approach to the influence of language in human learn- 
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ing would suggest that such influence is to be sought toe 
to be called as follows: fixing the level of incentive, reinfore 7 
ment, discrimination, generalization, cybernetic cues, an 
concept formation and thinking. 

Fixing the level of incentive. 
tion in the liter. 
tain linguistic 


° It is a commonplace assump- 
ature of anthropology and sociology that cer 
events can serve to increase or decrease R 
ondary incentive in the listener. (See section on Apne 
learning in Chap. 7.) This conclusion is supported by e 
perimental evidence (Hurlock, 1927). . a 
Reinforcement. Certain items of language, having bea 
associated with primary reinforcements many times durin z 
their acquisition, come to have fairly stable secondary A 
forcement properties (Schmidt, 1941, and Miller and r 
lard, 1941, pp. 28-35). Language probably also affects ‘as 
influence of delay of reinforcement by providing self-stimu 
tion involving Secondary reinforcement. . 
Discrimination. Language is used rather ubiquitously m 
connection with objects and events in the human’s environ- 
ment. It sometimes contributes to the learning process 


through mediated discrimination, which occurs when a rela- 
tively obscure stimulus i 


n said to haye acquired cue value (Miller 

and Dollard, 1941, p. 73). 
Generalization. 
Chap. 4.) Langu 
generalization in 


of stimulus aula 
hief factors in mediate 


ization of other responses 

n when they are called by 

6. In the light of prior discussion the term ‘i Sua labora- 

t ncentiye” some ela 

tion. In the Hullian scheme a distinction is ins between a alan in the 

poscos ON ‘whichicondi of certain antecedent conditions 

and motivation in the Sense of incentive Motivation (K), which phenomenon 
depends upon the anticipated magnitude of th oe 


Feo tories. We use the term “incen- 
Toperties of an even 


t of rei t which 
of such an ent of reinforcemen’ 
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different names (Birge, 1941; Miller and Dollard, 1941; 
Hull, 1939). 

Cybernetic cues. There are many data which confirm the 
hypothesis that knowledge of the extent and direction of 
nonreinforced responses is of great influence in facilitating 
learning. The information provided by linguistic cues is a 
very important source of such knowledge in humans (See 
Trowbridge and Cason, 1932; Lindahl, 1945; Underwood, 
1949, p. 416; McGeoch, 1942, p. 564). A special case of such 
cues is constituted by the initial stimuli presented to the sub- 
Ject, often in the form of verbal instructions by the investiga- 
tor, which have been shown to affect the rate of learning and 
hypothesized to affect the rate of problem solution (see the 
discussion of “set? in McGeoch, 1942, pp. 277-9). 

Concept formation and thinking. Problems of “concept 
formation” and “thinking” have rightly been judged crucial 
m attempts to utilize learning theory in the analysis of hu- 
man behavior by such diverse theorists as Maier (1940), 
Wertheimer (1945), Miller and Dollard (1941), and Dol- 
ard and Miller (1950). These problems involve such char- 
acteristically human phenomena as one-trial or no-trial 
earning. They are concerned, in general, not with the fate 
Of a previously reinforced response but with the discovery 
and first production of the “correct” response in a new set 
of stimulus conditions. , 

In this area there have been utilized such notions as im- 
plicit trials, insight (now as explanation, now as description), 
formation of a good Gestalt, change of the field, and the like. 
In the following section we will consider one of these notions, 
namely the implicit trial. The term “implicit trial” is adopted 

ecause it is current in the Hullian literature and will proba- 

ly convey the intended meaning to most readers. In any 
event a description of the phenomena referred to by this 
term will be found in what follows. 


Impuicir TRIALS 


Introduction. The Hullian theory features as one impor- 
tant analytical component the concept of the overt (rewarded 
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or nonrewarded) learning trial. This concept is useful in T 
analysis of certain kinds of behavior situations because pil- 
observation and counting of such trials increases the relia a 
ity of predictions about behavior in these situations. hee 
respect to other kinds of behavior situations, however; $ 
overt trial does not seem to be a useful analytical concep 
simply because in such situations overt trials do not a 
parently take place. Learning without apparent overt per 
formance includes, for example, some behavioral phenomen® 
often referred to as imitation, certain kinds of problem 
solving behavior, and so on. 


From the point of view of the application of Hullian 
behavior theor 


y to adapt it to the analysis of such 
cularly, is it necessary and/or desir a 
f such situations to postulate the ee 
al? Such a trial is, essentially, a kind of 
ably symbolic performance; e.g. it a 
ipulation of linguistic or other symbols. The 
associates certain elements of a symbolic 
system with himself and with various elements of the environ- 
es the former (i.e, sequentially arranges 
» in consequence, manipulates (in 
» including his own relation to it- 
fae! aati, ial-and-error learning process may 
ake place in the absence A 
There is no doubt hiatithess, soning 


7. From a research point of vi 
“trials” that the performance in 
subject himself, rather than b 
not, however, constitute a pr 
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sis of all behavioral situations. Further, certain observations 
upon performance make the notion of implicit trials at least 
plausible. Acquisition, for example, is typically more rapid 
When learning conditions are such as to permit intertrial 
rehearsal as opposed to massed practice where no such op- 
Portunity is present. 

The basic question as we see it, however, is not directly 
that of the adaptation of Hullian-type theory to the analysis 
of problem-solving behavior. Rather, it is this: What data 

© we need concerning problem-solving situations in order 
to predict successfully the behavior which will occur in such 
situations? 8 The postulation of implicit trials will be helpful 
to the extent that such a postulate helps to organize think- 
mg about the problem and to direct attention to significant 
aspects of the situation in such a way as to assist prediction.’ 

n what follows we have represented our several (and in some 
cases widely divergent) views on the matter of the analysis 
ot apparent nonovert performance learning, and have in- 
cluded such conerete research suggestions as seem promising 
to us. 

Possible analytical usefulness. As we have noted, implicit 
trials have the awkward characteristic that they are directly 
observable only by the individual performing them. The 
Possibility must not be overlooked, however, that the subject 
might be able to report the occurrence of such trials, and 

ence the investigator might gain knowledge of them. In 
addition, a symbolic trial may be wholly or partially overt; 
Le. the verbal symbols may be uttered aloud. Such overt sym- 
bolic behavior is itself recordable by an experimenter, but 
it is nonetheless symbolic in the sense that it does not involve 
the actual manipulation of the physical environment. Ac- 

8. The question may be asked: What, precisely, does one wish to predict 
about problem-solving behavior? For example, one might attempt to predict 
all the overt behavior that will be observed while the subject is en route to 
a solution or no solution or merely whether a solution will be reached. This 
Would seem to be a matter primarily of the interests of a particular investi- 
gator. It must be noted, however, that a decision one way or the other may 
affect the requirements of a theoretical system adequate to the prediction. 
de 9. In other words we need not waste time on the question: Do such trials 

Teally” take place? 
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cordingly we generate the notions of implicit and explicit 
symbolic trials.1° 

While prolonged research is a prerequisite to a complete 
formulation of the notion of symbolic trials, several assump- 
tions may serve as first approximations in order to render 
the notion occasionally useful. One such assumption might 
be that, at least for the normal adult human, symbolic trials 
always occur whenever the symbolic associations are availa- 
ble. Instrumental behavior, then, is always accompanied by 
symbolic behavior. Therefore, in order to know whether sym- 
bolic trials will occur in a situation, we must devise techniques 
for discovering whether the symbolic associations have been 
chnique might conceivably pro- 
as to whether the symbolic as- 
ame of reference provided by 
appropriate to the external 
l suggest the effect a sym- 


at a rate linearly related to them, 
provide a means for partially spe 
implicit symbolic trials, 
counting them. 


a study of the latter may 
cifying the nature of the 
erve as a first step toward 
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cal use of the concept of symbolic trials made explicit by 
Dollard and Miller. They believe that a patient in a psycho- 
therapeutic situation suffers partially because of his lack of 
associated symbols for such events as anger, fear, and the like. 
The symbolic-trial notion suggests to them that one value 
of therapy results from providing these labels in order that 
the appropriate symbolic trials can occur. 

_ More particularly, in that kind of problem-solving situa- 
tion in which the solution is recognizable by the nature of 
the problem or the instructions the subject may perform 
without ever making an overt error, because of his presumed 
ability to try out the alternatives symbolically. Dollard and 
Miller have suggested further that when the number of alter- 
natives is large a human may be able symbolically to try out 
responses backward from the goal, thereby circumscribing 
many symbolic errors. 

The extent to which these effects may be expected again 
presumably results from the previous symbolic learning of 
the subject. In some cases, at least, this may go beyond the 
simple symbolic association learning to include habits of 
symbolic manipulation. Specifically, the rules of the sym- 
bolic system may be of critical importance regarding the 
effect of a symbolic trial. Consequently knowledge of such 
rules may be valuable to the investigator. This may be 
elaborated as follows: 

In focusing attention upon the rules or perhaps some other 
general properties of the symbolic system in which implicit 
trials may be supposed to be taking place, we give up the 
notion of counting such trials. This would, of course, pre- 
clude the attempt to predict behavior which is importantly 
a function of the number of trials, rather than just the 
probable fact of some such trials. However, it seems plausible 
to us that this is a relatively unimportant behavioral cate- 
gory, since implicit trials may be an important determinant 
of behavior primarily for reasons other than those accounting 
for the number of them that take place in any particular 
behavioral situation. This would seem especially to be the 
case with respect to behavioral situations which may be 
categorized as constituting problem choices. In this situa- 
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tion the individual, when confronted with a stimulus, is con- 
scious of having to choose either the route to the goal = 
goals, or one of two alternative goals, and so on.? The sim 
plest kind of prediction regarding behavior in such a case 
would seem to be related directly to the outcome of the situa- 
tion; that is, we might try to calculate the probability ti 
the (unobserved) implicit-trial sequence will be terminate 
by one or another particular behavior pattern. 

ow can we go about this? We can sketch out only a 
preliminary and tentative approach in answer to this ques- 
tion. At the outset it seems clear that we must be able to infer 
what problem confronts the individual where this has not 
been set by the investigator. This might be done on the basis 
of the individual’s linguistic response to interrogation, or 
on the basis of inference from his observable instrumental 
behavior. For example, we might observe him with a stick 


in his hand Jumping up and down in an apparent attempt to 
place one end of the stick in the vicin: 


place, and 2. the probabili 
teristics of the language 
the environment in terms of the language will lead to a par- 
ticular result. Hence we must attempt to infer this datum and 
to assess the probabilities. 


As a simple example 
vidual who has materials for fort 


12. One might also categorize som, ao=problem 
choices.” The organism, when confronted with some stimulus, performs some 
behavior with no consciousness of ane i or “figure out”) 
the route to the desired goal. It seems ]j kaviar the Glas 
cept of an implicit trial is not of great importance, ie. is not of great assist- 
ance to prediction. 
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confidently predict that he will construct a square enclosure 
one hundred square feet in area. 

Although this particular example is trivial, the following 
analysis does help to bring out the essential aspects of this 
sort of prediction problem and may suggest lines for further 
development: 

1. In this case the language in terms of which the trials 
were inferred to be taking place was ideally consonant with 
the environmental problem. It would be hard to find a better 
language than that of calculus in terms of which to conduct 
implicit trials where one’s objective is to determine a con- 
strained maximum for a piece of construction. This sug- 
gests that a language may assist performance not only be- 
cause it permits any kind of implicit-trial sequence, but be- 
cause by means of its rules it permits a particular kind of 
implicit-trial sequence peculiarly pertinent to the problem 
in hand. This in turn suggests that, in attempting such a 
prediction, we must consider the rules of the language in 
which the implicit trials are (probably) taking place, in 
relation to the environmental characteristics of the problem 
situation. Whether this notion could be usefully extended 
to the case where the trials are probably occurring in terms 
of one or another natural language is a question. In our 
earlier example of a boy jumping with a stick to hit an ap- 
ple, suppose that a corpus of the language in question re- 
veals its rules to be such as to result in a considerable number 
of utterances of the sort, e.g- “Father spanks boy for climb- 
ing tree.” We might predict that the behavioral situation 
in question would terminate with the individual’s obtaining 
a larger stick and knocking down the apple. But this predic- 
tion would seem to be only a pseudo-use of the knowledge 
about the rules of the language to assist prediction. Actually, 
all we have done is to attempt to determine the culturally ap- 
proved route to the goal and then predict that in this in- 
stance it will be followed. In the case of either mathematical 
or nonmathematical language the rules of the language are 
a formal contextual matter, independent of any particular 
empirical reference of the elements in the linguistic system. 
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If, however, we are given a situation in which the elements 
of the linguistic system are assigned empirical reference, 
the difference seems to be this. With the mathematical lan- 
guage the rules are an important constraint upon the empiri- 
cal significance of any trial sequence in which the elements 
of the environment are in this way manipulated. When the 
empirical reference of the elements in the mathematical lan- 
guage is given, the rules insure that only certain trial se- 
quences (viewed as an empirical Phenomenon) will occur; 
furthermore, many mathematically controlled sequences are 
peculiarly consonant with certain environmental circum- 
stances. When the elements of a nonmathematical language 
are given empirical reference, the internal (formal) rules 
of the language do not seem to be such as to be an important 
constraint upon the empirical Significance of trial sequences 
which take place. 


2. Suppose we find a case in which the rules of the lan- 


reference) with another similar 
reference), and so on. Th 
But just to know that 


is undoubtedly learned is not very helpful analytically. We 
need to know something 


cue-response sequence taking pl 
in order to infer the probability that a particular behavior 
will result. 


Analytical difficulties. In much discussion of the implicit- 
trial notion (e.g. Hull and his followers) the investigators 
have identified implicit trials as analogues of linguistic 
Processes. According to them, anguage is necessary for 
thinking, and “ thinking” can be described in terms of ma- 
nipulation of linguistic elements, When a subject is asked 
to describe his “thoughts,” according to this Position, he 
can do so fairly accurately because he is giving an overt 
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verbal report of quasilinguistic processes which only he could 
directly observe. 

It is questionable whether the identification of implicit 
trials as linguistic processes is justifiable at all, even assum- 
ing that reports solicited from a subject are highly . cor- 
related with internal processes. Subjects will often describe 
visual or auditory imagery when asked for reports on how 
they solved a problem (Woodworth, 1938, pp. 183-825). 
Tt seems that even when these reports are taken at face value, 
implicit trials must include far more than mere quasilan- 
guage processes. The role of imagery has not been discussed 
at all in recent accounts of implicit trials, assuming the 
latter concept is to be retained at all. In an experiment by 
May, , for example, subjects reported verbal, motor, and 
visual methods of handling a very simple problem situation, 
even though all the stimulus material consisted of written 
words and was therefore ideal for encouraging “internal lan- 
guage processes” (May, 1917). 
_ In any situation where the prediction of human behavior 
is the objective, there seems at present only one way, even 
in principle, to ascertain the presence, number, and content 
of implicit trials: through a verbal report given by the sub- 
Ject. 

Now, human beings who are solving problems do not cus- 
tomarily give voice to their inmost thoughts at every stage 
of the process. In the experimental situation, if such reports 
are wanted the subject must be asked for them, and it has 
not as yet been shown that there is any correlation between 
his reports and his subsequent behavior, a question that has 
been discussed earlier. Even if it turns out that there is a 
correlation the notion of implicit trials adds nothing to the 
analysis, since our prediction must proceed in terms of the 
report and the subsequent behavior; anything interposed 
leads only to unnecessary complication. In any event the 
implicit trial remains, by definition, a postulated unobserva- 
ble, and thus, from most points of view, of no scientific utility 
until at least it has the status of an intervening variable in 
the formulation: ie. until the construct is operationally 
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bound to both ends of the S-R chain. Since the implicit trial 
does not have the status of an intervening variable, the in- 
vestigator attempting to utilize this construct is actually 
just making correlations between the subject’s reports and 
his behavior.13 

Summary. In summary, then, we find that acceptance of 
the notion of implicit trials turns on the extent to which 
the investigator is willing to attribute properties to the 
model organism. For some investigators it provides a logical 
bridge from Hullian theory to predictive experiments with 
humans as subjects in situations where the time element is 
greatly extended and where one-trial or no-trial learning 
i ers the notion is not a necessary 
eriments. The present authors are 
camps. What is more important, 
ubstantially agreed upon the meth- 
eriments (see below, p. 102), even 
retical interpretation of the results. 


€ consideration of the influence of 
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Towarp a THEORY or Prostem Sonvine 4 
We have considered ab 
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ed internal state, 
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14. For a treatment of the Problem-solyin, rocess 
complex organizational behavior, see Bakke (i963), 48 relevant to more 
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what seem to be important variables in many human problem- 
solving situations. 

1. The subjects in such studies are not naive organisms 
but have a learning history which includes the “correct” 
movement-type responses leading to reinforcement (solving 
the problem). 

2. The total pattern of the stimuli is unprecedented in 
the learning history of the subjects (i.e. it is really a “prob- 
lem”). 

3. At least some of the stimuli or some other similar stimuli 
have been previously experienced by the subjects. These we 
will call “stimuli U.” 

4. Stimuli U have not been connected with the goal re- 
sponses of the problem at hand by previous reinforcements. 

5. The subjects command a vast system of previously 
learned responses (language), which through differential 
learning are characterized by their own transitional proba- 
bilities (Carroll et al., 1951, pp. 11, 13ff.; Osgood et al., 
1954), each item serving as both response and stimulus evok- 
ing the next element. . 

6. At least one of the stimuli U evokes some previously 
learned linguistic response. B 

Y. This response serves as a cue to further linguistic re- 
sponses, each following response acting as cue for the next. 

8. These linguistic responses serve also as stimuli to non- 
linguistic responses and objects, in accordance with the “con- 
ventional sign” character of the subject’s natural language. 

9. There is a sequence of linguistic responses including 
within itself a linguistic item which serves as a stimulus to a 
response (linguistic or nonlinguistic). This is the goal re- 
sponse for the problem at hand. Such a linguistic item we 
call the “counterpart” of the goal response. 

10. This counterpart is sometimes more probable than any 
competing response to the same stimulus. (When the response 
occurs, an “insight” or “restructuring of the field” is said 
to have taken place.) ; 

11. A linguistic response having been evoked, it may— 
through its own transitional influence on following elements, 
through generalization with responses similar along either 
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phonetic or semantic (linguistic and nonlinguistic distribu- 
tional correlations) continua, through remote associations, 
or through the atmosphere effect (Wilson, 1948; Sells, 
1936) —evoke linguistic responses leading to the counterpart 
of the goal response. f 

12. When the linguistic counterpart of a possible goal 
response occurs, its appropriateness will be considered in the 
light of the conventional-sign connections between items of 
the language and nonlinguistic objects and events; i.e. the 
language is a mechanism for the transfer of previous learning 
which in most cases can replace trial-and-error behavior, 
not always, incidentally, making for a “correct” solution 
(Sells, 1936; Whorf, 1950). 
bove propositions is not true for a 
will be no insight,?° i.e. no solution 
es to overt trial-and-error behavior 


ion of an empirical test of certain 
aspects of the above formulation, 


should be made. In such an empirical investigation there is 
apt to be considerable 


what would constitute 
However, this agreement would 


15. The fact that insight or reorganization depends on earlier training 
has found ample experimental support (McGeoch, 


1942, p. 528), 


Language 101 


fruitfulness of speculation regarding matters they have not 
directly observed. 

i Other investigators would extend the conceptualization of 
linguistic response to include those responses which, at least 
if our criteria for response definitions are adhered to (see 
Chap. 3), are reckoned as unmeasurable, undefinable, and 
uncountable; further, they would in effect attribute these 
stimulus events to a nonverbalizing problem-solving subject. 
Such investigators feel that the alternative to such a con- 
ceptualization would result in an undue restriction upon the 
range of important problem-solving phenomena which may 
be empirically investigated. There seem to be no a priori 
grounds upon which a choice between these two positions 
may be made. Our formulation will admit of either, at the 
reader’s discretion. (See our discussion of implicit trials, 
which dealt with a similar problem.) 

Previous studies of problem solving lack comparability 
because they either consider language influences haphazardly 
or fail to take them sufficiently into account. The studies of 
concept formation (Woodworth, 1938; McGeoch, 1942; 
Underwood, 1949) seem to be characterized by the desire 


to learn the conditions for the correlation of natural or 


artificial linguistic responses with stimuli presented to the 
ts by Luchins (1942) 


subject. A series of ingenious experimen 
demonstrated the effects of presenting stimuli in such a way 
as to determine some of the initial linguistic responses, and 
showed clearly the possibility of manipulating antecedent 
conditions known to relate to linguistic responses in such 
a manner as to make possible differential prediction, i.e. to 
test the theorem that the processes of “thought” proceed as 
if they were linguistic responses. j 

As we have indicated, disagreements regarding theory do 
not preclude agreement as to the variables which may be 
tested experimentally. In fact the thirteen propositions just 
listed suggest a number of variables which may be studied 
in problem-solving situations. Among these are: i 

1. The goal response. Special apparatus might necessitate 
an unprecedented response as the goal response; if so, com- 
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promise responses or response generalization might be in- 
vestigated. ; 
2. The number of stimuli U previously connected with 
goal or near-goal responses. Speed of solution might vary 
with this number. j 
3. The transitional probability system of the subject. 


One set of language probabilities might make for quicker 
solution than another. 


4. The conventional sign nature o 
The work of Osgood and others seems to suggest that mean- 
ings can be fruitfully studied by objective means. Individuals 
differing on tests of semantic differential might show differ- 
ent speeds of solution if an item on which they differed were 
a stimulus in the problem, 7 

5. Initial verbalization of the subject. Better prediction 
might be expected given more data from linguistic stimulus- 
response chains overtly supplied by the sub ject. 


6. The amount of verbalization up to some chosen point 
in problem solution. 


7. The relevance of the subject? 
solution. (See Moore and Anderson, 


f natural languages. 


S responses to problem 
1954, for a neat evalua- 
em-solving experiment.) 
oblem. The names of the 


ances than by others (G. Miller, 195 
the consideration of a Pproblem-soly 
a form does not appear as ano 

Suppose that subjects are pretested on Kent-Rosanoft 
word-association tests. From the Population of Tese subjects 
two groups are selected, depend, 


ing on their response to the 
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stimulus word “table.” 1° Group A is composed of those sub- 
Jects whose first response was “chair”; Group B are those 
who did not respond with “chair” at all or who gave it only 
after many other responses. If the two groups are then indi- 
vidually presented with a problem involving finding an ob- 
Ject hidden under a chair in a room containing, along with 
a number of other objects of about the same size, a chair 
(but no table), it might be predicted that if the word “table” 
were spoken to each subject as he entered the room Group A 
would display faster average solution of the problem than 
Group B. Such an experiment could be varied along a num- 
ber of dimensions: selection of groups (those who gave 
“chair” only as first response as opposed to those who gave 
it, but further down in the hierarchy) ; presentation of the 
stimulus word (table? for both groups as above, “table” 
for one and no word for the other, or “table” for one and 
some other word for the other, perhaps one to which Group 
B would be expected to respond with a misleading self- 
stimulus, etc.) ; subjects’ behavior after hearing stimulus 
word (silently going about problem versus being asked to 
verbalize versus being asked to respond with the first word, 
other than the stimulus word, that occurs to the subject). 
The experiments suggested above could be supplemented 
by others in which the nature of the rules of symbolic ma- 
nipulation is brought more clearly into the research design. 
In the proposed experiments the effect of a single linguistic 
response to a single stimulus word is all that is considered. 
But Howes and Osgood (1954) have shown that responses 
vary systematically with differing contexts in which the 
stimulus word occurs. In addition such variables as phonetic 
similarity, morphemic form-class membership, and syntactic 
characteristics might be investigated for their relationships 
to the exigencies of a particular problem. For a real test 
of the possibility of using the propositions listed above to 
serve as a bridge between a Hullian-derived learning theory 
and problem-solving behavior, calculations of the transitional 


16. Russell and Jenkins (cf. Osgood et al., 1954) found that among Minne- 
Sota college students 844 out of 1000 gave responses showing “chair” as a 


response to “table.” 
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probabilities of utterances relevant to the problem would 
have to be made. These calculations would form a considera- 
ble task in themselves, as the technical note to this section 
(below, pp. 104-8) will testify, but in addition they would 
make problems of experimental control much more difficult 
since it would be necessary to test subjects for transitional 
probability comparability (Jenkins, 1954). 

The classification of r 
difficult part of any inv 
or must respond oy 
the responses are of 
proach to the problem to date has been that of Omar Khay- 
yam Moore and his 
at the Naval Resea 


they are not immediatel 
lems, Moore’s techniqu 
and point the way to increased ri 
ticability in the investi 


Technical note: a sample transition 
chief difficulty facing the studies pr 
of analyses of the transitional probabilities on the various levels 
of linguistic analysis; a beginning in this d 
being made (Carroll, 1958), Bey 
consider the results for on 


al probability analysis. The 
oposed above lies in the lack 


17. The semantic units of select: respond one to one with 
the units that describe what occur. ) 
18. “Tactical” includes both morphological and syntactic considerations, 
of morphemes in utterances, 
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utterance to be analyzed can be taught to infrahuman animals, 
it is only homo sapiens, as Voegelin (1951) has pointed out, who 
can make any choices at all in such an utterance. The infrahu- 
man organism can select the utterance only as a whole or not at 
a Ths speaker of English can make roughly the choices listed 
w. 
The notion of transitional probabilities is an important one 
in the analysis of verbal behavior. It has reference to the limita- 
tions put upon the occurrence of any element X when given some 
preceding element or sequence Y (which may, of course, be zero). 
Consider the utterance, Polly want a cracker?, which might be 


rendered phonemically as /2pali’wan? ‘krae. 5kor/, where 
pitch phonemes are numbered from one to four from low to top, 
and stress phonemes are /'/ primary, /A/ secondary, /’/ terti- 
"y and /“/ weak.!? In what follows we shall largely ignore 
Pitch and stress in the interests of simplicity of exposition, al- 
though of course they are involved with transitional probabilities 
just as much and in much the same way as vowel and consonant 
Phonemes. 

Before the speaker begins to say anything of the utterance 
Polly want a cracker? the phonemes available for his first choice 
of one are almost all those of English, perhaps excluding only 
/ž/ (the middle consonant of measure).”° 

Once /p/ is selected as the first phoneme, the possibilities for 
what is to occur in second position are greatly limited. The 
ove and before the first segmental 


are defined as coexistent, although 
ext indication of stress. We owe to 


pate Stress phonemes are written ab 
Phoneme of the Stetsonian pulse and 


decrescendo, with all phones until the n 
loch (personal communication) the notion that /'/ is coexistent with the 


entire sequence /wanə/, i.e. that there is no onset of weak stress before or 
after /n/. Ergo, two folksy “syllables” are included in one pulse. Pitch phones 
are spans having as their domain all phones (except of course voiceless 
ones) until the next indication of some different pitch phoneme. 
Psi /ņ/ occurs initially in some dialects, e.g. /énay'sgow naw/ Cc 
21. The notion that the individual phone is the unit of choice is, even on the 
purely phonological level, @ considerable oversimplification. Joos (1948, 
PP. 107-8, 109ff.) has shown that the articulatory and acoustic characteris- 
tics of phones are significantly influenced by at least the immediately preced- 
ing and following phones and in some cases by phones beyond those. It follows 
that the unit of linguistic choice is at least as long as the contribution of any 
particular phone to the total articulation, or, in terms of Joos’s theory, at 
least as long as the shortest innervation wave (Carroll, 1958). Irvin, Walker, 
and Osgood (Osgood et al, 1954) describe units of encoding in terms of 


"n I go 
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iou? 
next phoneme can only be drawn from the group /ylrwiou 


əeæia/. For example, the speaker might have said: 
/y/ Pew supported Martin for senator. 
/1/ Please pass the cake. 
/t/ Promise you'll come, Betty. 
/w/ Pueblo Bonito is in New Mexico, isn’t it? 
/i/ Peas and potatoes are what I like. 
/0/ Polish is a Slavic language. 
/u/ Pool your resources, men, 


/?/ Paupers are forcing this country into bankruptcy. 
/?/ Putnam began his career in ichthyology. 

/e/ Pettiford plays the double bass. 

/2/ Patrick is his middle name. 

/i/ Pillow fights are not allowed here. 


Any one of the above utter, 
with the first pulse. Whe 
phoneme, only /u/ and / 
other cases the Possibilitie: 
chose /a/ as second (seg: 
as third member one of 


ances is a possibility with /*/ and 72 
re /y/ and /w/ are taken as secon 
e/ respectively can follow, but in the 
S are more numerous. Since our speaker 
mental) phoneme, he could have chosen 
the following: 
/p/ Papa... 
/t/ Potter... 
/k/ Pockmarked . za 
Pod. s 5 5 

/m/ Pompous . . é 

/n/ Pontiffs . . 4 

/£/ Poffenberger ‘ 

/s/ Possibly nner 

/8/ Posture oes 

/v/ Poverty Tri 

/2/ Positive . . ; 

/h/ Parting . 

/w/ Pouting . | 

/y/ Pie. 
“vocalic skill sequences” (probably individual words and trite phrases) 
which are encoded as units and 


t run themselves “once initiated” and 
vocalic skill components which we tentatively identify with syllables rather 
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Since our speaker chose /l/ as third member, his choices for 
fourth member were limited to the following: 

#7 Policy +=» 

/?/ Polock ... 
Since our speaker chose /i/, he created a morpheme boundary 
and thus vastly increased the possibilities for position 5. These 
are any vowel or consonants except /1/ or /Ž/, since Polly may 
be followed by talks, drinks, eats, Whitworth, Jones, etc., etc. 
After /w/ is selected as the first phoneme of the second segmental 
morpheme, however, the choices are again narrowed. They are 
restricted to the following vowels by virtue of the fact that /’/ 
began with /w/: 

/i/ weaves... 

// wiggles . - - 

// walks... 

/o/ wont... 

/u/ wouldn’t ... 

/2/ was... t 

Je/ West... o 

/Æ/ wags... | 
Since the speaker chose /a/ instead of any of those above, the 
Possibilities for position 7 are limited to the following: 


/š/ wash... 

// Wallace .. - 

/t/ Watrous .. . 

/č/ watch... 

/d/ wadded ... 

/g/ (polli)wog .. - 

/¥/ wow’d (Polly wow’d ’em when it was her turn to sing) « + - 
/y/ wiped... 

/b/ wobbles . . - 

With /n/ chosen for seventh position, the alternatives for the 
eighth member seem to be only: /t/ wanted, and /2/, the one 
chosen. At this point again, the alternatives for position 9 are 
vastly increased since a morpheme boundary occurs after /2/, 
i.e. almost any phoneme in the language may occupy position 9 
except, as usual /9/ and /Z/, since depending on whether /2/ 
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is taken as fo or as a, any “verb” 
low. When /k/ is selected 
the tenth member are then: 


or “noun” in English may fol- 
for position 9, the possibilities for 


// clan... // kiss... 
/¥/ quilt... /?/ at... 
/y/ cucumber . . , /a/ cot... 
BL Kep ie. /u/ cool... 
/e/ kettle... /o/ coat... 
/e/ cat... /?/ coffee cup... 
/x/ having been chosen, the Possibilities for eleventh member are: 


/i/ cream... 
/3/ crimson . Sor 
/?/ cruller . . , 
/a/ crock . ete 


With /æ/ as eleventh member, 


/u/ crooked .. . 
/0/ croak... 
/?/ crawfish . . . 


the next may be: 

/n/ cranberry . . , /s/ crass... 

es crab... /š/ crash... 

Y/ crag... f/ Kraft? “ee 
eo ans /f/ Kraft’s (candy) 


a mber, the distribution of 
pitches and stresses makes it impossible that anything but a 
vowel come next, Besides /?/, which is chose 


- + + 5 the probabilities are 


of cracker, but the fact that other se- 
quences may occur in this ositi i : 
to be witty) makes th position (for example, in an attemp 


ore difficult than it might be 
cultural phenomena, the result 


CHAPTER 6 


FREE BEHAVIOR 


of our discussion has assumed, implicitly or explicitly, 
4 general conceptual categories of S-R psychology, par- 
ticularly as represented by Hull. The data on which these 
categories are based have come primarily from controlled 
experimentation with single subjects, in which attention is 
usually focused upon one particular class of responses. By 
contrast most of the behavior which social scientists study 
differs in two important respects. In such behavior, some 
variables which are fixed in classical experimentation are 
partly determined by the subject; we shall call this free 
behavior. In addition other individuals are often an impor- 
tant component of the environment. Finally, the subject 
typically can choose among several possibly rewarding per- 
formances. In this chapter we shall be concerned with free 
behavior situations which, we think, require some essential 
modifications of an approach such as Hull’s. 


iÈ line with certain of our objectives in this book much 


Tur Frer BEHAVIOR OF A SINGLE ORGANISM 


In the typical experimental situation most of the known 
parameters of learning are controlled by the investigator. 
For example in a simple bar-pressing (for food) situation, 
the investigator may control the following (viewed as inde- 
pendent) variables, among others: 

1. Total number of trials per unit time and th 


distribution of these trials. 

2. Number of hours of food deprivation prior to any set 
of trials, assumed to remain constant to a reasonable first 
approximation throughout any set of trials. (In general, all 
critical prior experiences of the subject.) 

3. Magnitude of the goal object. (Generally, all critical 


properties of the environment.) ) 


e temporal 
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As noted above, with respect to most of the per ae 
fronted by social scientists experimental control of the mae 
vidual and the environment is not possible. pe! se 
course, certain statistical control techniques availab a er 
investigator of such problems, by means of — = this 
attempt to “hold other things constant.” Neverthe rs Re 
consideration does not obviate certain fundamental dis Jit 
tions between the two kinds of situations. We shall a- 
helpful in examining these distinctions to consider the an 


i i 3 r havior 
sis of one experimental example of a simple free bel 
situation. 


Suppose a bar-pressin 
lows: The sub ject lives 
He presses a bar for food 

is free experimental sj 


8 experiment to be designed a 
continuously in the problem wil 
» and this is his only source of es 
tuation is analogous to the simp i- 
of free human behavior situations: say a castaway who A 
vides his time between leisure and the acquisition of the o. 
food item upon which he subsists, 


ree experimental situation as m 
many free behavior sit ions, the subject’s own berat 
e investigator) determines the tota 
number (per unit time) and time distribution of performance 
rewarded or not, Hence, depending 
upon the progress of ] 


earning, the subject partially deter- 
mines the number of rewarded 
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elaborate this point following presentation of some other 
necessary concepts. 

In the analysis of the free bar-pressing situation the first 
question to be answered is: What shall be utilized as a re- 
sponse dimension or measure? The usual possibilities are 
latency, amplitude, frequency, and resistance to extinction. 
Of these measures, frequency would seem to be the most 
appropriate. 

In this connection some general discussion of the problem 
of response measures in free behavior situations will be help- 
ful. In S-R psychology generally, and in the Hullian scheme 
in particular, a good bit of emphasis is put upon a unit 
of the subject’s experience commonly termed the “trial.” 
A trial is said to begin when the subject is introduced into 
the stimulus situation and to end when he is removed from 
it. Thus the number and time sequence of opportunities to 
perform are controlled by the investigator. In free behavior 
Situations generally it is not possible to say when a “trial” 
has begun or ended; that is, the trial as just defined is not 
a relevant unit of the subject’s experience. This means that, 
however we interpret our response dimensions, we cannot 
define them in terms of the trial. For example, we cannot use 
latency in the sense of the interval between introduction to 
the stimulus situation and completed performance ; nor could 
We use frequency in the sense of the ratio reinforced to total 
trials. In free behavior situations we can, generally speaking, 
substitute the concept of the performance for that of the 
trial and define our response measures in these terms. One 
response dimension which we can definitely record in this 
Situation is the number of performances of bar pressing, 
reinforced or not (n), and we shall adopt the number of per- 
formances per unit time (n/t) as a response dimension.* 

Frequency in this sense and latency in the sense of the aver- 
age interval between performances are the same dimension.) 


1. In the special case in which the bar delivers a food pellet every time it 
is pressed, the number of performances (n) and the number of reinforced 
performances (N) are the same. Generally, the investigator can differently 
arrange the ratio N/n. This matter will be further discussed in connection 


with the free behavior models to follow. 
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The response measure n/t requires some pme 
We attempt to predict the time of occurrence o to predicting 
future performance, this would be analogous ry suggests 
the outcome of a single trial. The Hullian then A a state- 
that any such prediction would be in the form ould occur 
ment of the Probability that a performance bability hap- 
at a particular time. Unless this predicted pro adi a single 
pened to be one, an observation upon the ontant o of this 
opportunity to perform would not serve as a on weri 
theory.? If our objective is to test this theory, th 


PH umber © 
have to make Predictions about the outcome of a n 
performances, 


We might attempt to 
rate of perf 


There will 


j.e. time 
predict the value for n/t (i.e 
ormance) ove 
exist, general 
his means 


to 
rill 
vor in question, the harder W; 
5 tiga- 
n, plus the particular interests of the investig 

tor, would determine į 
wha 


ati 
that the analysis of this free behavior si 


. : me 
PPproached in terms of what is commonly ter 
“comparative Statics.” 


2. See our discussion (Cha 


onse 
P: 8) of probability of response as a resp 
not to say that 


jes 
. It appears from unpublished work done in F., S. Keller’s laborator! n 
that for some time interyals n/t(t) would be generally cyclical in form 
an experimental design such as the one under discussion. 


Free Behavior 113 


some period of time that n/t(t) becomes equal to a con- 
stant.4 Let us adopt the terminological convention that in 
such an instance the subject is said to be in behavioral 
equilibrium, i.e. performing at some constant time rate.° 
In comparative statics attention is focused upon shifts in 
the equilibrium position, supposed to be consequent upon, 
for example, changes in the values for certain environmen- 
tal elements. With reference to the free behavior bar-pressing 
situation, suppose the size of the food pellet obtained on each 
bar press is increased. This might be expected to alter the 
equilibrium rate of performance. In comparative-statics 
analysis our problem is not to predict what will happen dur- 
ing each successive episode of behavior following the change 
in pellet size—for in any event the organism presumably will 
again settle down to some equilibrium rate of performance. 
Our task is simply to predict at least the direction of any 
shift in the equilibrium position. 
The concept of behavioral equilibrium simplifies behavioral 
analysis in a number of ways, principally, perhaps, by per- 
mitting a comparative-statics approach rather than an ap- 
Proach in terms of a fully dynamical model designed to pre- 
dict the precise behavioral path of the organism through 
time. Of course a good bit of information is suppressed in 


4. The shape of n/t(t) would be expected to vary with the time unit 
Selected. Presumably there is some time unit such that if the environmental 
circumstances of the behavior are held constant n/t(t) will become constant. 
We subsequently discuss the matter of whether the Hullian theory would 
Suggest that this is the case. 

5. The notion of behavioral equilibrium could be formulated more gen- 
erally. Suppose a time unit to be selected such that n/t(t) maintained, say, 
a generally cyclical form, rather than converging to some one value. Now 
the subject may be said to be in (a moving) behavioral equilibrium as long 
as the form of n/t(t) stays the same, ie. as long as an expression could 
be found to estimate n/t correctly over a number of future successive time 
Periods. We might then attempt predictions about changes in the values for 
the parameters in such a function. For our purposes, the simpler notion of 
behavioral equilibrium will do. 

6. It must be noted, however, that an investigation of the stability of a 
particular behavioral equilibrium may involve some analysis of the situation 
in terms of behavioral dynamics designed to determine whether there do 
indeed exist the behavioral forces necessary to drive the organism toward 
its equilibrium position. For an application of a Jearning-theory type of 


formulation for such a purpose, see Duesenberry (1949). 
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focusing attention upon equilibrium Positions alone. Never- 
theless, if the situation is such that equilibrium time rates of 
performance do exist, it is often precisely these rates in which 
we are directly interested rather than the outcome of each 
and every behavioral episode. For example, consider the 
individual demand function in economics.’ Suppose the price 
of beans to fall. We are not so much interested in whether 
Mrs. Jones buys more beans on any particular occasion, such 
as the next time she goes to the store. Rather, we are inter- 


ested in whether her equilibrium time rate of bean consump- 
tion goes up or down. 


One particular feature of 
mentioned here. We have pre 
for applications of Hull’s theor 


stance that in many human behavioral problems the learning 


of the subject prior to the time of observation and predic- 
tion is extensive. We haye Suggested that, rather than at- 
tempting to unravel this learning history in an attempt to 
infer sEr values by applying the principles of learning to 
it, it will be more feasible to develop direct methods for deter- 
mining these values. Suppose, however, that the subject may 
be viewed as in behavioral equilibrium at the time of predic- 
tion, and our problem that of predicting the direction of 
shift in this equilibrium position. In this instance the abso- 
lute values of the sEr’s need not concern us. Whatever these 
values, we need determine only the change in them conse- 


S of environmental parame- 
ters. (And this we might aspire to do by an analysis of the 
learning history of the subject subsequent to the parameter 
shift in question.) 


Now let us look at the free behavior situation from the 


ic of æ considerable portion of economic analysis. 
Since this is so, the possibility of significan: 


t integration of economic theory 
and psychological theory depends i 
parative-statics type of analysis in 
attempt among other things to show the possible fruitfulness of such a 
development. Further, we point out i between analytical 
models so developed and analogous developments in economic theory. For 
a discussion of comparative statics, its relation to dynamic analysis, etc., see 
Samuelson (1947). 
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point of view of developing several equilibrium models. The 
problem of explaining the existence of a behavioral equi- 
librium will be seen to be that of specifying the equilibrium 
conditions ; and these we will need to specify in order to pre- 
dict the direction of change in equilibrium values. 

The notion of a relation between performance level and 
drive level is central to the analysis of the free behavior situa- 
tion, and this matter deserves some preliminary discussion. 
In a very general sense, the concept of drive in the free 
behavior situation is analogous to the same concept as 
utilized in the usual analysis of controlled experimental 
situations. The hunger drive, for example, may be thought 
of as some function of food deprivation. Beyond this, how- 
ever, the free behavior situation demands a considerable 
modification of the treatment usually accorded the drive con- 
cept in the analysis of learning situations. There are two 
consequences of a reinforced performance: 

1. The positive effect of a rewarded performance: learn- 
ing is more complete the greater the number of reinforced 
performances. 

2. The negative effect of a reinforced performance: a re- 

inforcement which reduces drive reduces the tendency to per- 
form. 
A considerable part of the difficulty in constructing satis- 
factory free behavior models involves the matter of achiev- 
ing a satisfactory synthesis of these positive and negative 
effects. 

Insofar as the influence of drive is involved, the usual 
learning analysis primarily concerns the first behavioral 
phenomenon described above, under the two conditions that 
hours of deprivation are controlled by the investigator and 
that reinforced performances are held to be neutral with re- 
spect to the drive status of the subject. The essence of the 
free behavior situation is largely that neither of these condi- 
tions obtains. Considerable attention must be focused upon 
the second behavioral phenomenon which relates to the nega- 
tive effect of reinforced performances. 

In the usual analysis we are concerned with values for drive 
existing at those particular points in time at which reinforce- 
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ment takes place. In the free behavior situation the values of 
h (and hence D) at any point in time depends upon the sub- 
jects own past behavior within those limits provided by the 
environmental constraints; that is, h depends upon the time 
distribution of reinforced performances prior to the point of 
time in question. However, for an analysis of continuing 
time rates of performance in the free behavior situation it 
will be best to think of D as some average of its various levels 
at particular points in time. Thus we may write the decreas- 
ing function D(N/t) ; i.e. the average level of drive prevail- 
ing for the subject will be a decreasing function of the time 
rate of reinforced performances. Since the investigator will 
control N/n, we may also write D(n/t), asa decreasing func- 
tion. 

With this much background, we now offer several models 
for the analysis of the free behavior situation. These models 
are not completely satisfactory. In exploring various pos- 
sibilities, however, we shall at least illustrate the general re- 
quirements of the comparative-statics type of analysis. Fur- 
ther, we hope to elucidate certain major problems confront- 
ing the construction of such models. 


Frere Benavior MoprL 1 


This model is intended to be in a form which seems most 
directly allied to the usual Hullian approach. 
propriate to adopt the micromolar type of analysis discussed 
earlier. The dimension of behavior in which we are interested 
is the time rate of performance (n/t), and different rates 
will accordingly be treated as different “micromolar re- 
sponses.” 8 We need, then, to estimate the effective excita- 
tory tendency (sEr) for each rate in order to predict the 
most probable rate of performance, 


Since the relevant components of 
(sHr), incentive motivation (sKr or 
active inhibition (Ir), let us inquire as 


It seems ap- 


sEr are habit strength 
K), drive (D), and re- 


to the relations of these 
8. The micromolar approach is discussed in Chap. 
4, pp. T2ff. in Chap. 3, pp. 45ff., and Chap. 
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constructs to n/t. The positive relationships are shown in 
Fig. 1. These were arrived at in the following manner: 

In any situation, sHr grows to unity at the limit. Since we 
are here concerned with terminal (equilibrium) n/t under 
some specified conditions, not with the rate of attainment of 
this equilibrium, sHr for each different n/t response will have 
attained unity.” The horizontal function in Fig. 1 repre- 
sents sHr graphically at each n/t. 

The K variable is dependent upon magnitude of reinforce- 
ment which, in turn, depends upon n/t. In the simplest set of 
conditions of reinforcement, the ratio N/n is a constant. In 
this way the amount of food received per unit time clearly 
is an increasing linear function of the rate of responding, 
i.e. We (n/t). It is postulated that sKr is a growth function 
of this amount of food, i.e. K(Wg). Accordingly the func- 
tions Wg(n/t) and K(Wg) generate the function K(n/t) 
shown in Fig. 1. 

The unique feature, alluded to earlier, of the free behavior 
situation is seen in the D function. Drive is no longer directly 
controlled by the experimenter but is partially dependent 
upon the subject’s behavior. Obviously, the greater the 
amount of food the subject receives per unit time, the lower 
will his D be maintained. Since D is thus a function of Wg 
and Wg is a function of n/t, the relationship D(n/t) is de- 
rived, as shown in Fig. 1. 

The sEr for each micromolar response can be calculated 
by multiplying sHr, K, and D. Multiplications of the three 
functions appearing in Fig. 1 yields the sEr curve shown in 
Fig. 2. From this must be subtracted Ir, which is a function 
of the amount of work involved in responding. Since higher 
rates require greater effort, Ir is dependent upon n/t ac- 
cording to some function as shown in Fig. 2. 

Fig. 3 then represents the subtraction of Ir from sEr, and 
accordingly depicts the sEr value for each n/t. The most 
probable rate is that with the highest sEr value. Since the 
subject is assumed to maximize sEr, ie. to maximize 


Jd for extremely high rates, but since they will dis- 


9. This may not ho 
this question need not detain us. 
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(sEr — Ir), we have as our first-order equilibrium condition 
that E’(n/t) = I (n/t). 

As indicated earlier, we want equilibrium conditions in 
order to predict at least the direction of shift of the equilib- 
rium position consequent upon a change in some parameter 
of interest. In the present free behavior bar-pressing situa- 
tion we might attempt a number of such predictions. Since 
any one of these will serve to illustrate the techniques in- 
volved, we will for expositional simplicity restrict ourselves 
here and in the next model to one prediction, namely: Sup- 
pose two groups of similar subjects perform in free behavior 
bar-pressing situations of the sort described. The conditions 
for the two groups are identical except that for one group 
the magnitude of the goal object per bar press is larger than 
for the other. The problem is to predict for which group n/t 
will be the larger in equilibrium. 

In attempting this prediction it will be helpful to write out 
our equilibrium conditions more fully: 


E’ (n/t) = D(n/t) X K’(n/t) + K (n/t) 
xX D’(n/t) = I’ (n/t)." 


We neglect H since it will have the same value for all rates of 
performance, and at the outset let us neglect the problem of 
alteration in the slopes of the D and K functions. We will 
mention this matter later. Now, according to the postulates 
of this model, an increase in the magnitude of the goal object 
will increase K (n/t) but will decrease D (n/t), and hence un- 
ve enough information to predict the net effect we 
cannot predict the effect of a change in the weight of the goal 
object per bar press upon the equilibrium rate of n/t. 

Before passing on to Model 2 we shall discuss certain as- 

10. Where X(Y) denotes X as some function of Y, let X’(Y) denote the 


Arst derivative of that function. We shall drop the subscripts from sEr, 
etc. since this will simplify exposition without causing any confusion of 


meaning. ý « 
We should also note that oscillation (sOr) implies that maximum sir 
will vary from moment to moment; n/t would therefore presumably vary 


about the most likely equilibrium level. 
11. For simplicity, this expression is not written out fully. Let Wg mean 


rate of acquisition of the goal object. Terms such as K’(n/t) expand to 
K’(Wg) x W g (n/t), ete. This matter will be discussed later. 


less we ha 


120 Behavior Theory and Social Science 


pects of Model 1, mainly the matter of incentive motivation, 
K. In Model 1 the mi 


different n/t’s as 
for K as depende 
ment associated 
rather than assumin 


own rate of perf 
sentially an incom 
the older utility 
may have perce 
sion of the Hull 
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vidual supply curve of labor. We 
matter in what follows.) Incentive 
widely different interpretation 1 
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e usual context, which does not 
ates of behavior as different be- 
ith the subject’s own performance 
of the goal object per bar press 18 
change as it does in Model 1, inde- 
the ratio of reward to units of ef- 
arded behavior, Thus, in the usual 
an be interpreted as a psychologi- 
s having psychological importance 


12. The income effect concerns the importance of value received per unit 
time independently of the work involved, whereas the wage effect concerns 
the importance of value received 


tavolved per unit work independently of the time 
involved. 
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about this term in illustration of our point will likewise apply 
to D’(n/t). As before, let Wg stand for the rate of acquisition 
of the goal object. Now, K’(n/t) = K (Wg) X Wg’ (n/t). 
The value for the second expression on the right-hand side 
is the wage rate, treated strictly as an environmental param- 
eter. Of course, a change in magnitude of goal object per bar 
press alters K’(n/t), but it does so via this environmental 
parameter, while the psychological parameter in this situa- 
tion, namely K’(Wg), remains unaltered. 

Whether or not a general behavior theory needs a wage- 
rate effect as a psychological parameter of the subject can- 
not be settled at this time. But a possible redundancy may be 
involved in defining (as in the micromolar approach) dif- 
ferent behaviors in such a way as to make K an income effect, 
and then maintaining both this effect and a drive effect in 
the analysis. In the free behavior bar-pressing situation 
higher rates of acquisition of reward (associated with higher 
n/t) mean also lower prevailing rates of hunger drive (as- 
sociated with higher n/t). These two phenomena might be 
viewed simply as the two sides of the same coin, rather than 
as independent data in the explanation of the behavior in 
question. Thus we might establish equilibrium n/t for the 
subject with the relation I(n/t) and either K(n/t) or 
D(n/t). 

From the point of view of recognizing possible relations 
among the various behavior sciences, it is of interest to note 
the following: If the view suggested above on the redundancy 
of including both D(n/t) and K(n/t) in the analysis were 
adopted, and the former dropped from the analysis, then 
Model 1 would become very closely analogous to the older 
utility analysis of the individual supply curve of labor. That 
analysis postulated that utility was an increasing, negatively 
accelerated function of income level. Given a wage rate, a 
function was set up completely analogous to Model 1’s 
K(n/t). It was further postulated that disutility (from 
work) was an increasing positively accelerated function of 
amount of work. Hence there was a function analogous to 
Model 1’s I(n/t). It was then postulated that the subject 
would work, in equilibrium, at that rate which would maxi- 
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mize net utility, i.e. utility minus disutility. This is analogous 
to Model 1’s maximization of sEr. Beyond the interest in- 
herent in simple recognition of this relation between the 
two formulations, there is another reason for mentioning this 
matter. We earlier pointed out that Model 1 would not de- 
liver a prediction about the effect upon equilibrium n/t re- 
sulting from a change in the magnitude of reinforcement per 
bar press because K(n/t) and D(n/t) moved in opposite 
directions given a change in the magnitude of goal object per 
bar press. The older utility analysis did not include analogues 
to both D and K, but only to the latter. Even so, the older 
utility analysis could not make the prediction in question, 
and this would suggest that Model 1 would experience the 
same difficulty even without the opposing effect of D and K. 
That this is indeed the case is easily seen. Suppose D(n/t) 
is dropped from Model 1 but K(n/t) is retained. Since H 
remains a constant, our simpler equilibrium condition be- 
comes: K’(Wg) X We’(n/t) = I’(n/t). Now suppose the 
weight of the goal object per bar press is increased, e.g. 10 
per cent, and the subject continues in the first instance at the 
same n/t.’* This means I’(n/t) stays the same. Our problem 
now concerns K’(Wg) X Wg (n/t). If this expression stays 
the same, the subject will continue at the same n/t. If it in- 
creases, the subject will increase n/t and will decrease n/t if 
it decreases. We know that a 10 per cent increase in the 
weight of the goal object will increase Weg’ (n/t) 10 per cent. 
Since K(Wg) is postulated to be an increasing negatively 
accelerated function, and since, given the same initial n/t, an 
increase in the weight of the goal ob ject w 
know that K’(Wg) has decr 


condition, even if we 
D(n/t) and K(n/t), 
a st achieve full specifi- 
cation of K (n/t) before we can make the prediction ieee 
tion. 


18. For a discussion of the utility analysis of the indivi 
* dual e 
of labor, see Robbins (1930, pp. 123-9), who makes the pdt wie about 
to make. 
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Frere Benavior MoDEL 2 


Let us now turn to Model 2, which, although not based 
upon maximization as an equilibrium condition, also con- 
fronts certain difficulties over the opposing positive and 
negative effects of reinforced performances. We have previ- 
ously developed and explained the relation D(n/t), which 
will also appear in this model. We make the following as- 
sumption: The higher the general behavioral activity level 
of the subject, the greater the drive (within limits). The por- 
tion of this activity which is relevant to the effective drive 
(i.e. contributes more or less directly to a reduction of the 
drive) will depend upon the learning status of the subject. 
But in any event, whether this portion is high or low the gen- 
eral behavioral activity level is assumed to vary as indicated 
with drive. 


As pointed out in our earlier discussion of response defini- 


tion and measurement, danger inheres in the practice of 
treating as actual units of behavior theoretical constructs 
whose presumed empirical counterparts cannot be opera: 
tionally identified. Hence we wish to emphasize that the con- 
struct herein adopted, namely “a unit of seeking or striving 
behavior (B),” is a theoretical construct. It is not proposed 
that B’s be counted ; it is proposed in this model that postula- 
tion of them will assist in an adequate conceptualization of 
the free behavior problem and in the prediction of units of 
behavior which can be counted, in this case n/t. It is postu- 
lated that during any interval of time in which the subject 
is experiencing hunger drive he will engage in a certain 
amount of general activity. Some proportion of this will con- 
stitute a class of activity which may be thought of as “at- 
tempts to perform” those responses which will result in re- 
duction of the drive in question. The term B denotes a unit of 


joubt that in an experimental design such as 


infrahuman subject, B must retain strictly the 
status of a theoretical construct. In the case of human subjects, however, 
the concept of B might be given more direct empirical plausibility, inasmuch 
as such subjects have the power of verbalization. In any event, we are of 
course primarily interested in developing models suitable for the analysis 


of human behavior, although upon occasions infrahuman experimental con- 
texts may provide an initial simplicity essential to concept development. 


14, There is perhaps no d 
the present one involving an 
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such attempts, and it is postulated that B/t(D) is an noe 
ing function; that is, as drive increases, the amount of t e 
subject’s striving will likewise increase. The two bia pee 
D(n/t) and B/t(D) suggest the first critical functional rela- 
tion for Model 2: “D” = “p” (n/t, B/t) 15 

The function “D”“D” appears in Fig. 4. The only prop- 
erty of this function considered significant for immediate pur- 
poses is its negative slope. In Fig. 4 we measure n/t on 
vertical axis and B/t on the horizontal axis. The slope 0 
“D’“D” is negative by postulation because the greater n/t 
(and hence N /t), other things being equal, the lower will be 
D; and the lower D, the less will be seeking or striving B. 
This relation represents the negative effect of reinforcement 
in the free behavior situation. 

We have two variables, n/t and B/t. Thus far a psycho- 
logical property of the subject connected with drive has fur- 
nished one source of relation between these. Additional psy- 
chological properties of the subject will suggest other such 
relations, and in particular one which will allow us to take 
into account the positive effects of reinforced performances. 
For this purpose we direct attention to n /B, which represents 
the ratio of bar-pressing performances to units of attempt- 
ing or striving, and which may be thought of as a skill co- 
efficient. We know that generally speaking, given a constant 


environment, performance of a given response (variously 
measured) will, through the learning process, approach some 
stable level.16 Because this 


t j ! is a continuing free behavior 
situation, sufficient N will occur in time for n/B to reach its 


15. The notation “D” has b 
with some role of drive in S-R Psychology, at th 
this composite relation from any particular Hulli e; 
statement of the relation SD? i 
quently, are presumed constant and have 
above text relations such as D(n/t) should, perhaps, have been stated as 
(D, n/t) =k to avoid the implication th ive is vi 
variable whereas in fact it has the stat; 
variable. However, the mode adopted h; 
“intervening” status of so-called “intervening variables” in the analysis of 
free behavior situations ; that is, ct such as drive has the property 
that although on the one hand it is yi as a determinant of behavior, on 
the other it is determined by behavior, 


16, Of course if the environment were constantly changing (a possibility 


cen adopted to preserve the general analogue 
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limit, some constant value. Since n/B = n/t: B/t, we have 
the second critical relation needed for Model 2: 


“H” — “H” (n/t, B/t).27 


In Fig. 4 the function “H” is represented as OH,” and 
the slope of this function is equal to n/B. The particular 
“H” illustrated is one of a class of functions of the form 
Y = aX +b. In the relation shown in Fig. 4, b = 0, and 
we may for the moment ignore the value for a since this will 
be discussed shortly. 


Hypothetical 


D 
Schedule X 


9 xo xi x2 Bh 


1 
“Drive” 
(— increases in this direction) 


Figure 4. Solution of Free Behavior Model II, showing two sources of rela- 
tion between response rate (n/t) and “striving behavior” rate (B/t). The 
“D” function is based upon a drive concept and the “H” function upon a 
skill concept. The intersection of these two functions yields the equilibrium 
n/t. (See text for description of the other parts of this figure.) 


enhanced by the consideration that generally the environment of most organ- 
isms contains other organisms as one of its most important components), 
the subject’s behavior might never converge by trial and error to a behavioral 
equilibrium. This has been suggested as a possible reason why the application 
of trial-and-error learning theory to the analysis of certain kinds of be- 
havioral situations might not be fruitful (see Alchian, 1950). 

17. The terminology “H” is adopted to preserve the general analogue 
with the associative or learning factor in S-R psychology, but to distinguish 
the composite relation in question from an H function such as is utilized 


in Hullian analyses. 
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We now have our basic formulation, the two simultane- 
ously determined variables n/t and B/t, and two sources of 
relation between these. Generally speaking the system should 
be determined at the point where these functions intersect, 
assuming these relations to be independent and consistent. 
Before investigating the stability of this equilibrium, how- 
ever, it will be well to consider the following. In a system of 
this nature an intervening variable such as drive does not 
appear explicitly as a variable at all, but rather implicitly 
as a postulated source of functional relations among certain 
elements of the theoretical system. This relation is supposed 
to be due to some property of the subject. Similarly, with 
respect to the intervening variable H, n/B is not to be viewed 
as a numerical value for something called H. Rather, n/B 
is a certain relation between n/t and B/t, again suggeste 
conceptually by some property of the organism.?$ P 

To continue with our discussion of Model 2, we must 1m- 
vestigate the stability of the supposed behavioral equilib- 
rium. We must determine whether the supposition of the 
existence of nonequilibrium values (due, say, to some exter- 
nal random shock to the system) would imply the presence 
of forces such as to drive such values toward the equilibrium 
values. Referring again to Fig. 4, and noting the solid black 
line “DD” and O“H” functions, let us take XO as the 
value of B/t which is less than the equilibrium value X1. 
According to the relation O“H” this implies a certain value 


for n/t, in this case YO. But, according he relation 
“DD,” a value for n/t equal t ree 
such as to motivate the behay 
is greater than XO. Hence a 
not long persist, but rather B/ 


he reader may test out a value for B/t 
greater than the equilibrium level, say X2, to determine that 
forces are implied to drive it back to the equilibrium value. 

18. Thus our use of intervening variables in this case is not to be confused 
with the sort of conceptualization of them implied by the usual formal 
treatment, where some relation such as R(h) has in principle broken down 
into two relations, namely R(D) and D(h). Then, again in principle, actual 
numerical values are to be ascribed to D and incorporated formally into 
the theoretical system. 
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So far Model 2 has not taken explicit account of the factor 
of incentive motivation (K) which appears as an important 
element in the usual Hullian formulation. In this model the 
magnitude of the goal object, upon which K depends, is best 
viewed as a shift parameter in both the “D”“D” and O“H” 
relations. We can elucidate this point by returning to the 
prediction utilized in conjuction with Model 1. With two 
groups of subjects, one of which has a larger magnitude of 
goal object than the other, can we predict for which group 
the equilibrium value of n/t will be the greatest? In Hull’s 
formulation a larger magnitude of goal object and hence of 
K would, other things being equal, be expected to be as- 
sociated with a higher strength of tendency to perform, on 
some interpretation of that measure. In Model 2, with O“H” 
of the general form Y = aX + b, the value of the coefficient 
a (i.e. the slope of OH”) is viewed as dependent upon the 
magnitude of the goal object. More particularly, a larger 
magnitude of goal object would be expected to be associated 
with a greater slope for relations such as O“H”, say a slope 
such as O“H*, Other things remaining constant, this would 
be expected to increase n/t. Other things will not remain 
constant, however. An increase in magnitude of the goal ob- 
ject will also have a negative effect upon the “D”“D” rela- 
tion, shifting it downward and to the left—say to PHT) ?*, 
The reason for this is that with greater magnitude of the 
goal object there will be greater drive reduction associated 
with any level of performance n/t, hence a smaller value of 
B/t associated with any level n/t. This effect would, other 
things being equal, tend to decrease n/t. The net result will 
depend upon the relative strength of these two effects, and 
in general we cannot predict the outcome without this knowl- 
edge. It is a most awkward characteristic of such free be- 
havior situations that any alteration of magnitude of goal 
object may set up positive and negative effects in opposite 
directions, precluding prediction without a fully quantified 
theory. This point was made in a different way in connec- 
tion with Model 1. 

Another aspect of this model remains to be considered. We 
have thus far left out of account the negative factor of work 
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inhibition. It seems best to handle this factor as another shift 
parameter in the “D”“D” function; i.e. an increase in in- 
hibition (in this situation due, say, to an increase in bar re- 
sistance) should be expected to shift “D”“D” down and to 
the left. This means that if the performance of B/t, in addi- 
tion to reducing drive as a result of the associated level of n/t, 
also results in the accumulation of inhibition to oppose the 
performance, then we should expect still smaller values of B/t 
to be associated with any value of n/t.2® : 
Before passing on to Model 3 we shall examine certain ad- 
ditional aspects of Model 2. In connection with models of 
this nature, it is important to maintain a distinction with re- 
spect to intervening constructs such as drive: between drive 
in the sense of the function D(n/t) and drive level in the 
sense of a particular point on that function. As the analysis 
was set up in Model 2, drive nowhere appeared explicitly as & 
variable but rather was conceptualized as a property of the 
subject responsible for a critical functional relation between 
other variables. However, a hypothetical drive function may 
be explicitly introduced, as was done in Model 1. This may 
be seen in Fig. 4, where to the left of the vertical axis a hypo- 
thetical drive function has been constructed. This indicates 
that drive is a decreasing function of the time rate of bar- 
pressing responses. In equilibrium, e.g. at B/t equal to x1 
and n/ t equal to Y1, the subject’s own behavior will establish 
a certain average level of drive. A variation in the equilibrium 
rate of performance will change the average level of drive 


prevailing, but it will not necessarily shift the drive function, 
and in this latter sense, 


É ere as a psychological parameter of the 
subject, drive is held constant throughout he analysis. The 
converse of the above Proposition, namely that a downward 
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shift in the drive function will not necessarily result in a de- 
crease in average drive level in the resulting new equilibrium, 
may be significant in certain kinds of psychotherapeutic 
situations.?° 

The major differences between Models 1 and 2 involve the 
matter of an explicit versus an implicit treatment of inter- 
vening variables, the number of behavioral dimensions se- 
lected for attention, and the associated difference in the treat- 
ment of the factor K. In Model 1 the intervening variables 
were treated explicitly and were scaled along the vertical 
axis of the illustrative figure. One behavioral dimension, n/t, 
was selected for attention. This single dimension of behavior, 
viewed as directly influenced by D, K, etc., was itself the 
dimension to be predicted. In Model 2, intervening variables 
such as D were treated implicitly as sources of the relation 
between the behavioral dimensions selected for attention, 
namely n/t, n/B, and B/t. Drive was viewed as motivating 
a different “behavior” (i.e. B/t) from those performances 
which reduced it (i.e. n/t), and the K factor was considered 
responsible for n/B. In consequence the various factors in the 
analysis, such as D, K, etc., were held to be operating upon 
different dimensions of behavior, and the performance to be 


predicted was some function of these. 

Returning to further consideration of the K factor in 
Model 2, we must examine more closely relations such as 
O“H”, of the general form Y = aX + b. These relations 
raise problems not all of which are susceptible to completely 
satisfactory interpretation, but we may at least point out 
some of their implications. Thus far no interpretation has 
been given the term b. There seems no a priori reason to sup- 
pose that relations such as O“H” must pass through the 
origin, i.e. have b = 0. It is plausible that during early 


ures may obtain their effects partly by 
function, i.e. a reduction jn the amount 
ence of given antecedent 
that a downward shift of 
of a function such as 
y result 


20. Certain therapeutic proced 
a downward shift of the drive 
of drive experienced by the subject in consequ 
conditions. However, reference to Fig. 4 will show 
the drive function will also result in a downward shift 
“DD”, The resulting decrease in equilibrium performance rate ma; 
in an actual drive level in the new situation no lower than that obtaining 


in the original one. 
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stages of learning positive rates for B/t might exist with 
zero rates for n/t; as a result b might be viewed as one kind 
of reciprocal index of habit strength which diminishes as 
habit strength increases and which reaches a zero value in 
the limit. Beyond this, a as a function of the magnitude of 
the goal object is viewed as an asymptotic value, also to be 
approached in the limit as learning progresses. Thus, in the 
early stages of learning, the O“H” function might occupy 
some such position as O“H?##* (Fig. 4) and to move during 
learning to some such position as O“H”. Learning is said to 
be complete under a particular set of conditions once a and b 
have reached their limiting values. If the positive effects of 
reinforced performance partially determine the final equilib- 
rium position, then the limiting values of a and b should vary 
with the conditions of learning and with the kind of behavior 
involved in the situation, It is clear that b cannot in any event 
be less than 0, nor a in any event more than 1; i.e. n/B can- 
not be more than 1. If, when learning is complete, these two 
values were indeed the limits always reached, Model 2 reduces 
to a much simpler conceptualization of the free behavior 
problem. Such a case is illustrated by the forty-five degree 
relation O“H”* in Fig. 4. In this case, Model 2 delivers & 
definite prediction as to the effect upon n/t of an increase 
in the magnitude of the goal object, which, since n/B can no 
longer be increased, must produce j 
ing “D”“D” downward and to th 
pi oe rg ig ares merely as a permissive factor rather 


As we have emphasized, in the free behavior situation n/t 
must be viewed as both an input to and an output from the 
subject. There will be only one value of n/t which, in its role 
as input, determines Just that D level Wtekcary Hs se or 
precisely this same rate of Performance n/t. In this simpler 
conceptualization of the free behavior situ ation the equilib- 
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rium condition is essentially a postulate that the subject will 
adjust his behavior (n/t) so as to maintain some homeostasis 
with respect to hunger-drive status.** In both Models 1 and 2 
it was noted that the factor N/n might be varied by the in- 
vestigator. However, this factor was held constant. In Model 
3 this factor will be introduced as an important integral part 
of the analysis. 
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_ This model for free behavior situations utilizes certain en- 
vironmental constraints exclusively for constructing one 
function, and bases a second function on other environmental 
constraints and certain properties of the subject. The model 
predicts rate of response in a simple bar-pressing situation 
involving one manipulandum and one kind of reinforcing 
stimulus. It bases this prediction on three environmental 
variables: schedules of reinforcement, magnitude of each re- 
inforcement (denoted M), and amount of work necessary for 
each response (W); M is measured in physical units of size 
and W in physical units of work. This simple situation may 
be complicated by introducing discrimination, delay of re- 
inforcement, and “choice” between several manipulanda. In 
this choice situation, the responses involving different ma- 
nipulanda may be followed by the same type of reinfore- 
ing stimulus, such as food, or with different types. After 
initial development of Model 3, we will discuss both types 
of reinforcing situations as well as discrimination and delay 
of reinforcement. 

Fig. 5 is a geometric representation of Model 3. This shows 
three functions: D, C,, and C,; D is determined by M, W, 
and some properties of the subject ; C, and C; are determined 
by schedules of reinforcement. ‘All three functions are plotted 
in terms of two measurable variables: n/t, or rate of response, 
and N/t, or rate of reinforcement; N/t indicates the rate at 
which single reinforcers are delivered, irrespective of their 
magnitude. 

21. Boulding (1950) has suggested that a homeostasis postulate represents 
the simplest possible theory of the organism. 
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The function D is analogous to “DD” in Model 2 and 
represents the effects of reinforcement on rate of response 
due to a lowering of motivation. This function has a negative 
slope, since the faster the subject (denoted O) is reinforced, 


a ie Me 


Figure 5. Solution of Free Behavior Model III, showing tw 5 
A S f rela- 
tion aee npon rate lb) and relaforcement. rete RTA ae C. 
function is based on the reinforcement ratio (the C, functi eat = 
val schedule is used), and the D fun, { ı tunction when an inter: 


ction is based upon d 
intersection of the two functions yields the equilibrium nee concept. The 
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the more satiated he becomes and the less likely is he to re- 
spond. D presumably approaches an asymptote as N/t in- 
creases ; this asymptote, labeled a in Fig. 5, shows the rate at 
which O responds when satiated. This rate may or may not be 
zero. On the other hand, if O is reinforced too slowly, the 
total amount of reinforcement becomes insufficient to com- 
pensate for the work done. If the reinforcer is food, for exam- 
ple, O could slowly starve at a certain low rate of reinforce- 
ment. This minimal reinforcement rate determines the second 
asymptote c, in Fig. 5. When N/t approaches this value, the 
equilibrium system will break down and the model cannot be 
used. Actually the D function in this model could be written 
with a maximum at some physiologically minimal value of 
N/t, but this is unnecessary for our purposes. Thus c shows 
the minimal rate of reinforcement which will keep the subject 
alive and responding. 

We now have two asymptotes for D. By making D nega- 
tively accelerated as well as negatively sloped we may write 


its equation as that of a simple hyperbola. This equation says 
that response rate falls to its minimum at satiation more and 


more gradually as N/t increases, which does not seem un- 
reasonable on the basis of various experimental data. Thus 


the equation for D is: 
J. (n/t — a) (N/t — c)=h, 
with & determining the ac- 


where a, c, and k are constants, 
Jate these constants to W 


celeration of D. Now we must re 
and M. l 
hen the animal is satiated. 


As noted above, a shows n/t w. r 
This parameter presumably would fall as W increases. Thus 


we would have as the simplest possible situation : 
2. a= a /W, 


where a’ is a proportionality factor which would vary from 
individual to individual. Making a independent of M repre- 
sents an assumption that n/t at satiation would be the same, 
no matter how satiation was reached. Experimental evidence 
can disprove this assumption and show that a depends also 
on M. Furthermore, the relation between a and W may be 
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nonlinear ; we shall assume it linear here, however, as a first 
approximation. ; 

Now c would decrease as M increases, since with larger 
unit reinforcements O could be maintained at a lower rate of 
reinforcement. But if W is increased, c must increase to main- 


tain the animal’s total economy. As a first approximation we 
may write: 


3. c= "W/M, 


where c’ is a proportionality factor. . 
Finally, arguments similar to these generating equation 
3 yield a similar equation for Ie. As work increases, the sub- 
ject responds at a faster rate to try to balance the input he 
receives in reinforcement for his output. But as M increases 


he can drop his output rate and maintain himself. With i’ 
as a proportionality factor, we have: 


4. k= KWM. 


Equations 2, 3, and 4 each have their terms in the first degree. 
This assumption of linearity may hold over a sufficiently wide 
range of environmental conditions to make the model useful. 


The assumption can always be changed, of course, but we 
shall hold to it for the present. 


sponses. This fixed number is ex 
which equals 1.00 for regular rej 
1.00 for partial reinforcem 


5. n/t = r(N/t), 


where the parameter r is given by: 


6. r=n/N, 
As the severity of the schedu 


: le increases, r increases and the 
slope of C, climbs further fro 


m 1.00, its limiting value.2? 


Nave referr 
/t interpr 


22, C, is an example of what we } Sa tog i ada 
an “opportunity function.” Were N © in earlier discussio: 


eted as rate of acquisition of 
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_ G is a function determined by interval schedules. In an 
interval schedule the animal is reinforced only after at least 
a fixed amount of time has elapsed since the last reinforce- 
ment. If, for example, O is on a one-minute schedule, at least 
one minute passes between successive reinforcements. If O 
responds more slowly than once a minute, however, he auto- 
matically puts himself on regular reinforcement, since each 
response will be reinforced. If he responds faster than once a 
minute, the first response he makes a minute or more after 
his last reinforcement will be reinforced itself. The interven- 
ing responses have no effect on N/t, the rate of reinforce- 
ment. Thus an interval schedule determines a maximal rate 
of reinforcement, N/t*, allowed by the fixed interval; for n/t 
greater than N/t*, C, is a vertical line, since O’s behavior 
does not affect his rate of reinforcement; ** for n/t equal 
to or less than N/t*, C, is a line with a slope of 1.00, We then 
have for C,: 
7. n/t = N/t, where n/t < N/t*, and 
N/t = N/t*, where n/t > N/t*. 

bove define Model 3 and allow 
quantification of D. If the model is correct, we hold W and 
M constant and determine equilibrium values, defined by the 
intersection of D and C, for several values of N/n. The 
equilibrium values of n/t and N/t should be fitted by a 
hyperbola of the form given by equation 1. This will be the 
function D for fixed values of W and M. Then, using the 
model, we can predict the quantitative effects of shifting W 
or M. The data from experiments where those variables are 
shifted and new equilibria established should quickly show 
whether equations 2, 3, and 4 are incorrect. If some or all 
of these equations are inadequate, new ones can be set up 
and tested through similar techniques. The original determi- 


e opportunity function 
f the individual supply 
terpreted as rate of 


The equations presented a 


the goal object, C, would be strictly analogous to th 
utilized in the so-called “preference system analysis” o: 
curve of labor. The reader is reminded that C, is in 
reinforcements, regardless of the magnitude of each. 

23. This may not be strictly true when O responds between a rate equal 
to N/t* and one equal to 2N/t*. For simplicity, we have omitted representa- 


tion of this fact from Model 3. 
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nation of D will give the proportionality constants a’, c’, and 
k’. All experiments would have to be conducted on the same 
animal or group of animals. With a group, a’, c’, and I’ 
would be interpreted as estimated population parameters. 
These might be relatively fixed for different groups of animals 
of one variety. . 

We shall now consider the problems raised by discrimina- 
tion, delay of reinforcement, and choice behavior for Model 
3. In a discrimination the subject faces the different schedules 
of reinforcement at different times. When one schedule is 
operative, an external stimulus S; is present; when the other 
schedule is operative, S, is absent. We denote the latter con- 
dition -S,. Usually the schedule in effect during —S; 18 
complete lack of reinforcement, N/t = 0.00. When this hap- 
pens O responds at a very low rate. Thus when N/t = 0.00, 
the presence of —S, prevents the animal from receiving rein- 
forcement and drives his rate n/t toward zero. 

Now let us suppose that S, is present a certain proportion 
of the time, p, and that —S is present the remaining propor- 
tion of the time, 1.00—p. We assume that n/t during -Sı 
is low enough to have little effect in the long run. If p = 1.00 
there is no discrimination, and equilibrium rates of n/t and 
N/t can be determined as previously. But if p is less than 
1.00 the animal must increase n/t during S; to bring its over- 
all rate of reinforcement N/t up to the value which would 
obtain if p = 1.00. If P is 0.50, for example, the subject must 
respond twice as fast during S, as he would if p were 1.00. 
Thus, in a discrimination, if n/t(1.00) would be the rate of 


response for p = 1.00, and n/t(p) is the rate during S,, we 
would have: 


8. n/t(p) = 1/p X n/t(1.00). 
Equation 8 is valid as lon 
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Before passing on to choice behavior, we shall comment 
briefly on the effects of delay of reinforcement. When delay 
1s introduced the animal must wait a certain fixed time after 
making a response which is “marked” for reinforcement, be- 
fore reinforcement is actually given. If he responds before 
that fixed time has passed, the original response is not rein- 
forced and the new one becomes marked. Thus with a two- 
second delay, when O makes a response which is to be rein- 
forced he must not make another for two seconds. If he does, 
} en and he must now wait for the 
reinforcement an additional two seconds without responding. 
Delay thus forces the animal to adjust n/t toa certain maxi- 
mal rate when reinforcement is regular. From the point of 
view of free behavior, the problem is whether that maximal 
rate is at or above the n/t necessary for equilibrium. If it is, 
then the model is still valid; if it is not, the subject suffers 


inanition. 
We shall conclude our discussion of Model 3 with a few 
wo classes of choice situa- 


comments on choice behavior. T 
tions must be distinguished. In the first, two responses are 
available and both produce the same reinforcer, such as food; 
in the second, each response produces a different type of 
reinforcer. As an example of the second, a response to one bar 
is reinforced with food and that to another bar is reinforced 
with water. These two classes of choice situations may be 
called “single reinforcer” and “multiple reinforcer” respec- 
tively. 
Model 3 offers two ways of treating the single-reinforcer 
choice situation. Suppose two bars are available, each with 
its own characteristic values for M, W, and N/n or N/t. An 
equilibrium value of n/t can be calculated for each bar 
separately. The choice problem is solved most easily by pre- 
dicting that the subject will choose that bar for which n/t 
is minimal, Thus we would expect O to end up using only one 
of the bars and ignoring the other. This solution assumes 
that the subject will minimize his output in a choice situa- 
tion. If n/t for each bar is equal, this solution predicts that 
O would spend equal amounts of time on each. In this way 
an indifference state could occur in such a choice situation. 


no reinforcement is givi 
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This solution, however, assumes that O can discriminate the 
different values of n/t. A more sophisticated analysis of this 
choice problem could be obtained by making the choice be- 
havior a probability function of the difference between the 
possible values of n/t. . 

In a multiple-reinforcer choice situation, Model 3 points 
to some singular complications. Suppose O has available hie 
bars, one yielding food and another water. If we consider 
the schedule for the first bar, we see that O is reinforced at 
a certain rate for responding to that bar. But his i ee 
to the bar yielding water are not reinforced by food, ani 
these responses unreinforced by food must be added to the 
schedule prevailing on the food bar. If O is reinforced mag 
larly on both bars, he actually is reinforced by food for all 
responses on a partial schedule. If his rates on both bars are 
equal, his food reinforcement schedule is effectively one 
reinforcement per two bar presses. Thus the multiple-rein- 
forcer situation effectively shifts the schedules for all re- 
Sponse possibilities, whatever schedule may be set externally 
for each one. Further development of Model 3 along these 


lines may enable a quantitative prediction of multiple- 
reinforcer choice behavior. 


We shall briefly elaborate our dj 
reinforcer situation to indicat 


al context of the Hullian analysis 
(in which we do not approach the problem in terms of be- 
Mparative statics), the introduc- 
(rewarding) goals also complicates 
1s only one rewarding performances 
bly perform whenever sÊr is above 
threshold. Suppose, however, that there are at least two 
responses, say R, and R,, Providing different goals such that 
at a particular moment both É, and Dare suprathreshold: 
Now, the probability that either R, or R, will be performed 


is equal to 1.°* However, the Probability that, say, R, will 


usual Hullian-type analysis. AS 
Pointed out, however, a subject 


Dollard and Miller (1950, pp. 352-69) have 
Is for a time at least elect neither, 


confronted with two rewarding goal may 
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be performed is less than 1, the exact value depending upon 
the difference between È, and E>. Let tx, te, ts, etc., denote the 
beginning of the first, second, third, etc., time periods. The 
outcome of performance in, say, tz, will influence the per- 
formance in ts, and the outcome of performance in ts will 
influence performance in t; and so on. Suppose the investiga- 
tor has made observations upon the subject’s learning history 
up to t,, and now wishes to predict future performance upon 
the basis of just this much information. Presumably he could 
make a probabilistic prediction of the outcome to be expected 
during t,. But what about t? Again presumably, he could 
make a probabilistic statement regarding the expected out- 
come in this period, but because a prediction about tz would 
hinge upon the probabilistic prediction concerning ti, and 
a prediction concerning ts would depend upon probabilistic 
predictions concerning t; and tz, and so on, there would be 
a rapid attenuation in the reliability of predictions. In other 
words, the existence of numerous goals would seem to de- 
crease greatly the time horizon of prediction. More impor- 
tantly, this consideration suggests the possibility that from 
a comparative-statics point of view the locus of new equi- 
librium positions may not be independent of the route from 
one to the other, and hence that predictions concerning the 


— 
rather remaining in some sort of behavioral equilibrium between the two. 
This will be the case if electing the one goal means giving up the other, 
and avoidance of the one (and of the other) is generated on this score. See 
their description of the double-approach-avoidance choice. This would seem 
to be a paradigm for the usual economic choice, i.e. in which the subject 
must allocate some scarce resource (money, time, energy, etc.) among @ 
variety of competing ends. The difficulty with direct application of this 
analysis to many economic choices is this. The analysis serves to explain why 
it is that the subject does not elect one goal or another at a particular 
point in time. In many economic analyses, however, we wish to explain why 
the subject does elect one goal or the other at a certain time rate during a 
period of time. Presumably, in the double-approach-avoidance situation, the 
accumulation of drive with the passage of time would force some choice, and 
the next choice would be influenced by the drive reduction in consequence 
of the initial choice, ete. Again, as in our discussion of the free behavior 
situation, the explanation of continuing time rates of performance would 
seem to depend importantly upon some statements about the growth of 
drive and its decrease due to performance—more importantly, perhaps, upon 
this factor than upon those explicitly incorporated into the double-approach- 


avoidance analysis. 
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locus of new equilibrium positions cannot be made bers 
knowledge about all the individual trials or episodes of Pe 
havior that presumably lead from one to the other. Of course, 
still within the usual Hullian type of analysis, the introduc- 
tion of several rewarding performances results in a number 
of additional analytical difficulties, especially those of ac- 
counting for the effects of possible stimulus generalization. i 
Some general features of Model 3, including contrasts 
with Models 1 and 2, deserve comment before passing on to 
the multiple-organism situation. ; del 
First, there is the matter of the role of learning in Mo 5 
8. When a subject first enters a free behavior situation he 
responds at a low rate n/t. Reinforcement of his initial re- 
sponses drives him out along the prevailing C, or C, functor 
so that he responds at increasingly higher rates until the 
equilibrium point is reached. The D function keeps him from 
exceeding the equilibrium rate of n/t, and both the D func- 
tion and law of effect keep him from falling below it. Simi- 
larly, when environmental variables change, O learns to 
adjust n/t to a new equilibrium value. “Learning” becomes 
the fact that O actually reaches 

equilibrium sooner or later.25 Quantitatively, however, 1n- 


y of learning, when combined 
rediction of the rate at wid 
& new equilibrium is demande 

ot yet studied the mathematical 


with Model 3, should enable p: 
O’s behavior will change when 


three models, behavioral 
learning is complete. H 
terminology, in which learn; 
the positive effects of reinfor, 


25. This is essentially the role ascribed to the learni sen- 
5 tning process by Due: 

berry (1949), who employs a learnin -the ; x sate He 
stability of a behavioral equilibrium S CEY formulation to investigate 


ium established on other grounds. 
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2 attempted to carry over the positive effects of reinforced 
performance as determinative not only of the fact of reach- 
ing some behavioral equilibria but also of the locus of such 
positions. Thus Model 1 utilized the concept of K as one 
determinant of the locus of the final equilibrium position. 
Model 2 suggested two possibilities. One was that the posi- 
tive effects of reinforced performance were determinative 
of the locus of equilibrium position, due to effects upon the 
n/t: B/t ratio. The other was that the positive effects were 
merely permissive, due to the fact that O“H” was assumed 


to have reached its limiting position. Since Model 3 utilizes 


only one motivation assumption, this model, even without 
bout the effects 


further quantification, makes a prediction a 
of an increase in magnitude of goal object upon n/t. This 
is not the case with Models 1 and 2, which utilize two oppos- 
ing motivational assumptions. 

These models also contrast with respect to the treatment 
accorded the influence of variations in work. Models 1 and 2 
utilize only one assumption on this score, namely that in- 
creases in required work will tend to decrease tendency to 
perform because of the accumulations of work inhibition. 
Because of this single assumption, Models 1 and 2 can make 
a prediction about the effects of an increase in work upon 
n/t. Model 3, on the other hand, utilizes two assumptions 
about the effect of increases in work. One of these is that, at 
low rates of reinforcement, increases in work will tend to 
increase performance rates due to the effect of increasing 


the physiological requirements of the organism. The other 


is that, at high rates of reinforcement (the satiation asymp- 
decrease performance 


tote), an increase in work will tend to 

rates. This leads to the prediction that two D functions 
quantified under different work conditions will cross each 
other, the D function where work is greater lying to the right 
of the D function where work is less for n/t above the inter- 
religon point, and to the left of it for n/t below the intersec- 
ion. 

_ We have previously discussed the ro 
intervening variables in Models 1 an 
intervening variables are used only to the ex 


le played by the Hullian 
d 2. In Model 3 Hull’s 
tent of borrow- 
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ing some notions involving motivation which appear in 
Hull’s scheme and in systems offered by many other writers. 
Model 3 ignores work inhibition, incentive motivation, habit 
strength, and so forth. Insofar as these intervening variables 
are useful, they might enter Model 3 as parts of a learning 
theory to predict rate of attainment of a new equilibrium. 
The model could accommodate any other theory equally well, 
as long as that theory yielded predictions about n/t, and used 
N/t as one basis for such predictions. The test of Model 3 
is, of course, the empirical program it suggests. We are 
quite certain that this program will force a substantial modi- 
fication of the model. Its present form is only one of several 
possible first guesses regarding the quantitative relations 
between variables of simple free behavior situations. 


CHAPTER 7 


SOCIAL INTERACTION 


one organism has been involved. Most phenomena of 

interest to social scientists, however, are those arising 
from behavioral interaction between two or more organisms. 
The same problems found in the single-organism examples 
also may appear in such interaction situations. The varia- 
bles which are considered antecedent or independent in 
classical S-R theory may themselves be functions of the be- 
havior of the participants in interaction situations; these 
participants usually have a long learning history which 
would be difficult, if not impossible, actually to unravel; and 
we are generally interested in studying the time rate of per- 
formance of various responses. The additional complications 
found in studying interaction rest on the fact that the be- 
havior of each participant is determined to some extent by 
the behavior of the others. 

Often it is contended that the behavior of individuals or 
sets of individuals cannot be handled by S-R theories when 
the behavior to be predicted is a function of the behavior of 
others. This broad generalization may hold better for some 
kinds of interpersonal effects than for others. 

When the influencing behavior has already occurred and 
can be described, its effects should in principle be subject to 
the same kind of analysis as are nonbehavioral conditions. 
Behavioral conditions are, however, much more complex than 
the kinds of stimuli typically studied by S-R theorists. Sim- 
ply to describe them as stimuli or stimulus conditions does 
not tell us all we need to know about them. Thus far, S-R 
theorists who refer to “stimulus similarity” or “strength of 
stimulus” with reference to the stimulus properties of human 
behavior have usually used the terms for illustration or post 
without specifying or using any operations 
defined. 


ik the free behavior situations considered thus far only 


hoe explanation, 
by which such properties could be rigorously 
143 
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But if human behavior could be systematically ie t 
stimulus values in an S-R theory, there is no reason w 7 E 
could not be used for the kinds of prediction we have s A 
cussed. Indeed, it is difficult to imagine a theory of hum : 
behavior which failed to consider the behavior of oe r 
an important determinant of the predicted behavior. E 
significant that analyses which classify individuals pn k 
basis of experience or exposure to conditions usually a 
phasize experience or conditions which result for the m 
part from the behavior of others, p baH 

More complicated than the effects of influencing beha of 
which has occurred in the past is the prediction of effects i 
behavior which will occur at some time after predich 
The simplest cases are those in which the investigator knov 5 
in advance how the influencers will act. This can be accom 
plished either through experime 


ing behavior occurs without re 


gard to the timing of the 
behavior of the predictee, 


it is difficult to predict what w 
the two will be. Since most A 
(e.g. contiguity of stimulus an 

eward), this makes prediction 4 
ole influencing behavior ee if 
s in some systematic relation to 
ree behavior situation remains & 
Xperience is a function of his own 


in the sense that it occur: 
predictee’s behavior, the £ 
problem ; i.e. predictee’s e 
behavior and vice versa, 


Many empirical studies have been 
of individuals or sets į 


> - More recently, Asch (1951) has 
developed a design for studying behavior in the event of & 
conflict between the individual's Sense perception and the 
reported perceptions of a group of which he is a member. In 
general, however, such studies haye been more concerned with 
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the group as a stimulus than with its effects in modifying 
response tendencies. More data on the latter process are 
needed before the utility of an S-R analysis in such problems 
can be evaluated. 

; Prediction of behavior of individuals and sets becomes par- 
ticularly complicated when the influencing behavior of others 
must itself be predicted. In effect, this may be viewed as a 
situation in which the behavior of several individuals or 
members of several sets must be predicted as a function of 
the behavior of each other. If habit tendencies, and therefore 
behavior, change as a result of interaction during the period 
between prediction and performance, problems of prediction 
would be enormous. But even if change occurred only in the 
stimuli presented by each participant, prediction of the 
temporal sequence in which these would evoke and be evoked 
by responses of others would seem very difficult on the basis 
of an S-R theory. At present, therefore, it seems reasonable 
to attempt only the prediction of time rates of performance 
of various responses or classes of responses. ae 

In the ensuing discussion of the problems involved in this 
type of analysis the following symbols will be used: A and B 
will denote individuals; Ral and Ra2 will represent different 
responses made by A, and Rb5d and Rbé6 will represent re- 
sponses made by B; S*Ral will represent stimuli created by 
Ral which are observable by B; S, and Sz will represent 
stimuli whose occurrence for one individual is not contingent 
on the responses of other individuals. J 

A single interaction situation can be fully represented in 
principle by a sequence of the following sort involving A 
and B: 

(Si, So, S*Ral) — Rb5 — (Sz, Ss, S*Rb5) — Ra? — 

(Sg, Sa, S*Ra2) — Rb8 — (Ss, S2, S*Rb8) — 
Ral5 — — —. 


this sequence would involve the use 


A complete analysis of 
R y nses and describe 


of a method enabling one to categorize respo S 
the stimulus situations preceding any response by an inter- 
actor A. This poses an exceedingly complicated problem 
which appears impossible to solve at present. A more com- 
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plete analysis of interaction, however, shows that this prob- 
lem can be considerably simplified. s p 

In the first place, the analysis of one interaction situation 
is primarily aimed at the correlation between the S*Rai’s and 
the Rbj’s. Stimuli to B which do not depend on the behavior 
of A or vice versa can be temporarily set aside, since We are 
interested in how the behavior of A affects the behavior of 
B. Under the conditions just outlined, interaction analysis 
must work with the following sequence: 


S*Ral — Rb5 — S*Rb5 — Ra2 — S*Ra2 — 
Rb8 — S*Rb8 — Ral5 ———. 


This leaves us with the problem of categorizing responses 
and specifying stimuli which arise from the behavior of A oF 
B. This latter requirement, however, is unnecessary if we 
make the following assumption: the physical stimuli S*Rai 
from any response Rai are always different from S*Raj aris- 
ing from Raj when ij, and are identical when į = j. This 
assumption in effect does away with the necessity of including 
the physical S*Ral, S* Rb, ete. in the description of an m- 
teraction sequence, and it implies that one problem of analy- 
sis of interaction is to treat the correlations between the re- 


sponses of A and those of B. The time sequence of interest to 
interaction analysis is therefore: 


Rb5 — Rag — Rbg — Ral5 


we have no guarantee th: 
given stimulus is ever 1.0 
havior may be such that a h 


É I igh correlation between stimulus 
and response is an infre 


J mediate purposes, however, We 
shall treat their effects as those of “random noise.” In doing 


this we may by definition say that an interaction between two 
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pene, A and B, occurs when the correlations between the 
ai’s and Rbj’s are at values above chance. 

Throughout this discussion we have assumed that we have 
some system for categorizing responses made by each inter- 
actor. We have already discussed the problem of classifying 
responses (see Chap. 8). Given some such set of categories, 
NS can ask first, what the correlations are between successive 
responses, and second, how the time rate of performance of 
each type of response changes during interaction. In study- 
ing these problems one may use pooled data for all inter- 
actors, or data for only one interactor at a time. We have 
discussed the first question above and will now turn to the 
second. 

Many previous studies of interaction have conce 
the prediction of whether, how quickly, and with how many 
errors (e.g. Shaw 1932; Preston, 1938) the interacting 
group will achieve some final goal, such as the solution of a 
problem. This is essentially a question of predicting the time 
distribution of certain classes of responses which may occur 
near the end of the interaction. The jntercorrelations be- 
tween responses, which were discussed previously, provide 
one way of making such a prediction. 

_ Another method, not involving response-respon 
tions, is to study the time distribution of responses (Parsons, 
Bales, and Shils, 1953, pp. 111-40). S-R theory suggests 
certain variables which may influence the time distribution 
of a response or set of responses. These variables may be 
presumed to operate through the behavior of the interactors 
to influence the status of the interaction at any given time. 

During an interaction sequence the rate of a response may 
be variously modified. The Hullian approach suggests that 
rate of performance is an increasing function of level of 
drive and amount of rewarded practice as well as of magni- 
tude and immediacy of rewards. Interaction can affect each 
of these, An interactor (A) can heighten the level of an in- 
teractee’s drive by presenting the latter (B) with painful 
or fearful stimuli or by depriving him of the opportunity to 
reduce his drive. Alternatively, A can contribute to the re- 
duction of B’s drive, in which case, according to a drive- 


ntrated on 


se correla- 
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reduction theory of reinforcement, he also tends to reinforce 
B’s previous S-R sequences, increasing a given nonasymp- 
totic rate to a degree related to the amount and immediacy 
of drive reduction. Thus prediction of changes in rate re- 
quires knowledge of the frequency with and extent to which 
A reinforces B, and of the timing of these reinforcements in 
relation to B’s behavior. 

Several factors may be expected to contribute to the 
determination of reinforcement through interaction. First 
among these is the level of B’s drive, which may be low enough 
to preclude some kinds of reinforcement and minimize others. 
Drive level may have been reduced by previous interactions 
with A or other individuals, or by B’s individual actions. 
Whatever drives B has may or may not be reducible by As 
depending on the nature of the drives, on A’s previous learn- 
ing, and on environmental factors. If some action by A cam 
Q then reinforcement of B’s action 
is an increasing function of A’s tendency to perform this, as 
opposed to competing, nonrewarding behavior. By his be- 
havior, B can in turn affect the likelihood that A will reinforce 
him: by reinforcing and stimulating those of A’s responses 
o him and by not contributing to the 
) ble responses, 

Previous reinforcement of A’s reinforcing response, 
whether or not given by B, would appear important in its 


and “imitation.” Miller and Dollar 
have treated these mechani 
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from the behavior of the organism imitated; in the latter the 
imitator’s behavior becomes progressively more determined 
by cues from his own behavior which resemble cues from the 
model’s behavior. By reinforcing the imitator for “correct” 
behavior the model insures that the stimuli from such behavior 
gain secondary reinforcing properties and that those stimuli 
are like the stimuli generated by the model’s behavior. In this 
situation, stimuli from both the model’s behavior and the imi- 
tator’s behavior must be available to the latter. Generally, 
visual or auditory stimuli meet this condition. The correct 
Sequence of responses develops by chaining each response to 
the stimuli generated by the preceding responses. In the case 
of matched-dependent behavior the organism acquires a new 
response sequence by chaining each response to the stimuli 
generated by the model’s behavior; without the latter stimuli 
the imitator would be unable to perform correctly in a 
matched-dependent situation. 

There is a third situation, however, which has not been 
analyzed in discussions of response development in humans: 
an instructor provides verbal stimuli to which a subject re- 


sponds with a new sequence of behavior. In this situation the 
appropriate single responses have already been attached to 
the verbal cues offered by the instructor. The response chain 
would be developed by attaching each response to the cues 
of preceding responses. 9 [ 

A much more serious problem arises in studies of interac- 
tion and reinforcements given during interaction by the pos- 
sible existence of a phenomenon which we shall label, for 


convenience, “vicarious learning.” Workers in a number of 
disciplines have suggested that an increase m tendency to per- 
ults from the mere 


form certain given behavior sometimes res 

observation of that behavior being performed by a second 
individual. Psychoanalytic literature is replete with refer- 
ences to the inclination of children to model their actions after 
adults (e.g. Erikson, 1950, pp. 210-13). An outstanding 
theory of role learning emphasizes the factor of “consistency 
with which others in the individual’s environment exhibit to 
him the response called for by his role” ( Cottrell, 1942b; see 
also 1942a). In economics it has been suggested, notably by 
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Duesenberry (1949, pp. 17-46), that observation of Ee 
sumption by others increases the consumer’s tendency 
spend. l P 

Among the many attempts to explain this phenomenon, s 
few have used concepts close to those of behavior theory 
Duesenberry, for example, explains an increase in consump 
tion following “demonstration” by another consumer 1m 
terms of an increased “drive to get higher quality gason 
The stimulus of relative material inferiority presumat y 
elicits a desire for consumption or a fear of status loss which 
can be reduced by consuming as much as the paca Koa 
Miller and Dollard attribute copying to an acquired drive F 
copy which is reduced following behavior resembling that a 
the model. If this general approach is to be followed, it wou 
be useful to know under what circumstances such drives occur 
as well as how they affect performance. 

It seems likely tha 


t similarity or equivalence perceived by 
an individual betw 


een himself and the observed actor will 
prove to be one important determinant of the degree of leat 
ing to which such experiences give rise, Though the 1m 
portance of this factor has long been noted (Giddings, 1896), 
little progress has been made toward its measurement oF 
systematic inclusion in a theory of j 
we may be able to do little be 
and using them as independent 
plicit trials. 

Ultimately it would be use 
ceived similarity” of actors in 


Se taste “eS 
yond obtaining its measu! 
variables which determine im 


ful to be able to explain “per- 
terms of the learning processes 
which affect it. One might postulate that implicit responses 
occur when behavior of others is observed, and that such re- 
sponses are differentially rewarded, so that the observer 
learns to make them following the behavior of some, but not 
all, possible models. That differences in the types and num- 
bers of models result from diverse social environments 18 
strongly indicated in Psychoanalytic materials on identifica- 
tion and in ethnological studies (Murdock, 1949b). It re- 
mains the task of a systematic theory of social behavior to 


show precisely how a given environment results in a partic- 
ular pattern of vicarious learning. 
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aoe i have treated the analysis of a single interaction 
oy: if argely in terms of the sequences of responses made 
id Se inns In doing this we have ignored the role of 
es a not contingent upon those responses. An actual 
hn of interaction along the lines suggested here would 
ies r take account of such stimuli. These stimuli are of 
cal orts. One type includes those which arise from the physi- 
cal environment; the other includes stimuli presented by the 
interactors which are not contingent on behavior: appear- 
ance, age, physical size, and so forth. Many of these latter 
stimuli are correlated with general aspects of the behavior 
of the person affording them, and they may affect the be- 


havior of others. Thus the group membership of an interactor 
is potentially an important factor which can aid prediction 
f responses and sequential 


concerning rates of performance 0 
Correlations between responses. 

Much empirical work in the socia 
on the assumption that individuals w 
to behave similarly. The ill-defined term 
used to denote either an organization, i.e. an aggregate of 
mutually interactive individuals, or, more generally, a set, i.e. 
any aggregate of individuals differentiable from nonmembers 
by the possession of one or more common characteristics. 
Since all members of an organization have their membership 
as a common attribute, the first type of group is a special 
case of the second. 

Organizations include families, 
and societies. Anthropologists have particularly emphasized 
the proposition that membership in a society makes for simi- 
larity in behavior. Exemplifying this point of view, Ralph 
Linton (1945, p. 20) states, “The fact that most members of 
[any particular] society will react to a given situation in a 
given way makes it possible to predict their behavior with a 
high degree of probability.” The explanation of this similar- 
ity is to be found in terms of learning- Linton says further 
(1945, p. 14) : “When several persons react in the same way 
the cause must be sought in the ex- 
duals have in common. Obviously 
greater for the 


] sciences has been based 


ho belong to groups tend 
“group” has been 


various subsocietal units, 


to a particular situation, 
perience which such indivi 
this fund of common experience will be much 
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members of a single society than for members of different 
societies.” Thus membership in a given society is seen as an 
attribute correlated with given learning experiences and 
therefore with similar behavior. . 
Among nonorganized sets as well, similarities in behavior 
have often been demonstrated. Social scientists have looked 
for empirical correlations of various forms of behavior with 
such attributes as Sex, age, race, I.Q., occupation, education, 
residence, sibling position, and socialization. Correlations 
found by this method have often been left unexplained. It Is 
possible that many of them may ultimately be explained in 
terms of the differential learning to which such attributes are 
related, An explanation of this sort would have to take ac- 
count of several ways in which given characteristics affect 
learning. At the present stage we can only guess at these. 
Membership in sets can affect behavior by giving rise to & 
similar learning history in several ways. Sets may be dif- 
ferentiated in the kinds of stimuli typically presented: finger 
bowls are far more frequently seen by upper- than by lower- 
uent stimulus presentation limits the 
inforced trials, so that learning may be 
must be acquired. Members of sets ma, 


oa Pee sralinite for copyin 
sult of differences in this re “lis : i s a 
nT hiig A ita 
eg ie Maat, 
ananitude. immediney and pat ich seward fol- 
lows fl given stimulus res oy dos Srn with which seward fo 
dependent on factors in both th 


t : 
uence. Reinforcements ME 


e materia avi viron- 
ments. Social environments are E poela ad of 


Social Interaction 153 
pehavion they reward. Members of organizations typically 
earn to behave similarly. Some of their behavior usually has 
the effect of exerting positive and negative sanctions on the 
persons with whom they interact. To the extent that these 
controls are consistently exercised they will tend, other fac- 
tors being equal, to reinforce certain S-R connections and 
make for the elimination of others. It is to be noted, however, 
that even within an interactive group differential controls 
are evoked by different sets of actors. Physical or behavioral 
characteristics may provide the basis for differential control 
reactions to the same behavior. In our society women (or 
Negroes or children, etc.) present stimuli which serve to evoke 
control reactions to given behavior different from those 
evoked by similarly behaving men (or whites or adults, etc.). 
Though often based upon a class of perceptible stimuli, dif- 
ferential controls may be evoked or supplemented by cue- 
producing responses, such as “This person is a criminal” or 
“That person is sick.” The interrelations between these two 
types of stimuli and their connection with control responses 
deserve further study in such areas as class, race, and role 


relations. 


Even where the same consequences follow given behavior 


for different sets, differential learning may result. One major 
reason for this lies in the fact that sets may differ in their 
members? values, i.e. the kinds of states of affairs which are 
rewarding or punishing to them. While some value differ- 
ences result from innate factors, such as those associated with 


age or sex, a majority would seem to depend on learning. As 
a result of earlier experience, one man’s meat may come to be 
another man’s poison. Work of some psychoanalysts in par- 
TEREE ing the rela- 


ticular > heen dirgcted toward discern i 
cular has recently been EEA e e : 


tionship of early experience to va i é 
al-; 19 i but nilenily aema raion D a anen is eee 
= l nk à uifersntial value systems; 
idl ba A ay wee AE 
simple expla ih ob: dae elise: Kaf ff Es 
1; Fop an alte five apprsasi ts the concept of value ch Kluckhoha et 
at. (1081, pp. 386400): 
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tive to this, further work is needed in exploring the interrela- 
tion of values and conditions of reinforcement in their effects 
on behavior. 

Sets of individuals may also be differentiated in regard to 
their speed of learning under constant conditions of rein- 
forcement. General differences in the so-called “learning con- 
stants” may be correlated with intelligence test scores and 
other measures of performance when these are applied follow- 
ing constant training.’ It is possible that these constants also 
vary with the age of the actor, although this has not been 
conclusively established as independent of other learning (see 
Miles, 19383). As such tests are refined, it may be possible to 
show differences in the central tendencies of the learning con- 
stants of various sets. Such differences would be expected to 
contribute to differential behavior after a given number 0 
trials, and, for certain behavior, even at the asymptote. It 
should be noted that differential speed of learning may also 
give rise to reactions on the part of others, toward slow as 
against fast learners, which sometimes lead through the con- 
trol mechanisms mentioned above to ma jor differences in the 
conditions of reinforcement typically confronted by members 
of different sets. An example is to be found in educational 
systems which adopt learning speed as a criterion for further 
training. 

Differences in learnin 
bear not only on the re 
but also, by g 
stimuli and responses. Tho 


zation gradients, these have not been adequately described. 
On the other hand, distinctive Seneralization gradients base 
upon learned equivalence or distinctiveness of stimuli * are 
characteristic of certain sets—foy example, those comprising 
native speakers of 2 given language (Whorf, 1949) or indi- 
viduals receiving similar verbal instructions (Birge, 1941). 
2. Latency of a reaction followin a gi . ini been 
shown to correlate negatively with ntelligen do hs cng ng 19265 
McFarland, 1937a, 1937b). sen and Bornes 
4 the discussion of i i z 
i by DONO acquired equivalence in Miller and Dollard (1941; 
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S “fey 
a meke ees: a o to differences in the 
equal strength, generalized from S-R connections of 
x au hia ae ohne ele: history of set members may 
Ley ias ta peel g ha ani ee rewards in such 
E e cen mn i h dis inctive reaction potentials. 
cranial auc r is to be pr edicted at a given point in time, 
ie et m necessary to take into account, in addition to 
oe istory, the present situation of members of a given 
Helas se would include the nature of the stimuli currently 
rea presented and the degree of drive present. Even if two 
Pe ae identical in regard to their reaction tendencies, 
renee to them of nonequivalent stimuli usually evokes 
ns erential responses, while differences in degree of drive 
ay lead two otherwise similar sets to tranquility or frenetic 
activity, as the case may be. 
i Each of these several factors would seem able individually 
o produce characteristic behavior in a given set. When com- 
bined, their effects become very difficult to predict. Thus, 
members of a given society who have high drive but little 
previous reinforcement for fighting may have the same 
momentary effective reaction potential to go to war as 4 
neighboring society under the same conditions with low drive 
but much previous reinforcement for warlike behavior. With- 
out a quantitative system, it would seem impossible to predict 


which would be more likely to fight. 
In the real world, sets which are of greatest interest typi- 
mber of these characteristics. 
f these when in their experi- 
ments they assume tha » are constant. For 
their part, nonlaboratory socia 


mended when they seek to isolate the facto 
f such sets as races, classes, and mem- 


differential behavior 0 AC 
bers of various occupational and familial statuses. Whether 
this effort can be aided by @ learning approach remains to be 
demonstrated. : 

In the analysis outlined here we have tried to point out the 
actual operations that seem to be involved in studying inter- 
action. A theoretical description of interaction would include 
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the stimuli S*Raj in order to permit statements about 
stimulus generalization. But stimulus similarity in interac- 
tion could also be treated as a direct function of the physical 
similarity of the responses giving rise to those stimuli if an 
adequate method of categorizing responses were available. 
This, again, might help to simplify the operational problems 
of observing interaction, although it would not change the 
theoretical analysis which might be made. Acquired similarity 
of stimuli, however, would probably render an approach this 
simple inadequate, and in dealing with responses u 
acquired similarity of response-produced stimuli is involved 
it would be necessary operationally to reintroduce S*Raj 
into the operations used in observing behavior. 

The problem of stimulus similarity is also complicated by 
another factor: the type of response categorization used. Dir 
ferent categorizations will split actual behavior in differen 
ways and thus generate different descriptions of interaction 
and similarities between inter 

Finally we must point out that we have chosen to approach 
interaction from a theory of individual behavior in the hope 


4. A number of systems permit this kind 
fine ourselves to only one illustration. 
In his systematic sociology, Talcott Pa 


et al., 1951, pp. 47-279; Parsons, Bales, and Shils, 1953) has classified inter- 


vit ws, of the two systems: affectivity—imme- 
diacy of reward; collectivity—importance of rewarding interactees; univer- 
salism—generalization of behavior to a class of interactees; achievement— 
dependence of A’s behavior on sti li provided by B's responses (rather 
3 Specificity—limitation of interactive 


imuli. Each of t fi ariables is 
placed by Parsons in three systems, cul ach of these five v. 


. t 
7 tural, personality, and social; tha 
is, the actor may be normatively obliged, eE be pe inom d on probable 
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The advantage of such translation goes beyond the facili- 
tation of communication between social scientists. It holds 
out the hope that nonoperational variables which are taken 
as independent in other theories may become definable and 
dependent in relation to operationally definable psychologi- 
cal variables.’ With the aid of an explicit set of postulates 
relating these variables it should become possible to predict 
the experiences affecting previously independent variables. 


pain of sanction to perform a given kind of interaction. “Normative obliga- 
tion” seems to refer to verbal descriptions obtainable from members of 
the social group as to correct or desirable behavior. “Desire” is roughly 
analogous to reaction potential. Expectation might be given behavioral defi- 
nition in terms of the likelihood of reward for performance or punishment 
for nonperformance of given behavior. h 

5. For a criticism of the Parsons-Shils theory in terms of its failure to 
explain the pattern variables see Swanson (1958). 


CHAPTER 8 


CULTURAL BEHAVIOR AND 
STIMULUS-RESPONSE 
THEORIES 


[ie book has been largely concerned with long-run 


developmental problems in social behavior science- 

We feel that the problems raised are important ones 
from this point of view, and also that profitable discussion of 
them is not barred by the fact that many of these problems 
will probably not be resolved in the near future. Nevertheless, 
many social scientists are understandably interested in the 
matter of what results a given theory can deliver to them to- 
morrow or the next day, in addition to the matter of what re- 
sults the same theory may deliver at some unspecified future 
time when certain of its current problems have been satis- 
factorily resolved. In consequence we feel it desirable to make 
a few statements relative to the former matter. For the most 
part these statements will be general ones. However, brief 
descriptions of two attempts to analyze particular behavioral 
processes in stimulus-response terms have been included. 

At the outset of this section it must be observed that in 
inquiring into the applicability of psychological theory to 
human cultural behavior (i.e, behavior which is learned by 
one human being from another), we are dealing with an issue 
which has been the subject of strong and conflicting opinions 
among social scientists. Many have maintained that psycho- 
logical postulates are inadequate or misleading when applied 
to most sociological and anthropological data. Durkheim 
(1950) attacked sociological dependence on the individual 
psychology of his era in the following terms: “. . . because 
society is composed only of individuals, the common-sense 
view still holds that sociology is a superstructure built upon 
the substratum of the indivi 


idual consciousness . . . [but] 
58 
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pementality of groups is not the same as that of individuals; 
ae as its own laws.” Subsequent writers have also criticized 
i se who accept “the notion that to explain sociological 
a neg they must reduce them to psychological phe- 
a (Lundberg, 1939; Apple, 1951). Perhaps the most 
White anthropological view of the matter is set forth by 
be a (1949, pp. 140-1) who declares that “Culture must 
ch explained in terms of culture . . . not in terms of psy- 
i - ogy. . . . The most realistic and scientifically adequate 
interpretation of culture is one that proceeds as if human be- 
Ings did not exist.” 
a On the other hand, human cultural behavior has often been 
escribed in terms which suggest its susceptibility to indi- 
vidual psychological analyses. Sumner (1906, p. iv) was 
among the first to do this with his definition of folkways as 
habits of the individual and customs of the society which 
arise from efforts to satisfy needs.” The same emphasis is 
found in C. S. Ford’s description of culture as “traditional 
ways of solving problems . . . responses which have been ac- 
cepted because they have met with success; in brief, culture 
Consists of learned problem solutions” (Ford, 1942, pp- 547, 
555, 557). The latter definition, characterized by Kroeber 
and Kluckhohn as expressing the central tendency of psycho- 
logically oriented views of culture,! has been criticized by 
them on the grounds that “everything characteristically cul- 
tural has been dissolved out of Ford’s definitions except - - - 
traditional” The drift is to resolve or reduce culture into 


psychology” (Kroeber and Kluckhohn, 1952). 

A compromise view is proposed by Kroeber, who holds that 
“at present it is equally impossible to explain culture in terms 
derstand it without some 


of individual psychology and to un | 
reference to psychology- After all, culture exists only through 


persons, in or by their behavior. Yet when we study culture, 
we concern ourselves primarily with those aspects of behavior 
which are more than individual. Our generalizations, and 
therefore our specific scientific findings, are obviously on a 
more-than-individual level. But the individual and per- 


1. For a systematic discussion of possible definitions of culture see Moore 


(1952). 
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sonalized substratum is still there” (Kroeber, 1948, p. 577; 
see also Parsons, 1951, pp. 552-3). 

We think that the real issues in this controversy have all 
too often been obscured by mutual misunderstandings by the 
participants. Very few scientists would be willing to accept 
either of the following statements: No psychological theory 
can contribute anything to the understanding of any cultural 
behavior, or All cultural behavior may be fully accounted for 
by an extant psychological theory. Most would take the posi- 
tion, which we here assume, that some but probably not all 
cultural behavior may be usefully analyzed in terms of some 
theory of individual psychology. 

The question for us then becomes, What kinds of cultural 
behavior can be fruitfully analyzed in these terms? Though 
no conclusive answer can now be made, it should be possible 
to clarify the question. In order to do this it will be necessary 
to distinguish and discuss the kinds of theory referred to, 
and to discuss whether the behavior to be predicted is that of 
an individual or of some aggregate. 

First we would like to limit our discussion to a particular 
kind of psychology. Discussants on both sides of this issue 
often fail to specify the kind of psychological theory which 
they feel is or is not applicable to cultural behavior. Though 
of obvious importance, it is often crucially unclear whether 
by “psychology” is meant theories having to do with instincts, 
faculties, personality traits, fields, associations, fixations, OT 
theories involving some combination of these. Instead of using 
the general term “psy chology,” we shall therefore limit our- 
selves to a discussion of a particular class of psychological 
theories, namely those which seek to predict the behavior of a 
given individual in a particular situation on the basis of his 
prior experiences in behaving in a given way under similar 
conditions. These may be roughly designated as “stimulus- 
response” or “S-R” theories 

Second, we should specif 
to be dealt with. Despite oce 


y what kinds of phenomena are 
} € occasional disclaimers it is clear that 
most social-science activity is directed toward the study of 
some form of, consequence of, or inference from someone’s 
behavior. The behavior in question may be that of a specific 
individual, that of members of a category or set of not neces- 


Cultural Behavior 161 


sarily interacting persons having one or more characteristics 
in common, or that of an interactive aggregate or “group” 
of persons. Diverse problems arise from attempts to theorize 
about these different combinations of persons whose behavior 
1s to be studied. 

In what has gone before we have pointed out that stimulus- 
response psychology has concentrated, in principle at least, 
upon behavioral changes consequent upon the behavioral ex- 
perience of individual organisms in the context of an im- 
Personal environment. The qualification “in principle” is 
necessitated by circumstances which require observations 
upon the performance of groups of organisms if these ob- 
Servations are to constitute a test of the theory suggesting 
them, even if the focus of interest is to draw inferences about 
individual behavior per se. Of course, predictions in social 
Science may be useful for reasons in addition to the one that 
such predictions may constitute a test of the theory suggest- 
ing them; for example, as a basis for policy decisions (in 
which an attempt may be made to control the phenomenon 
under consideration). Thus explanations of individual per- 

ormance based upon suitable life learning histories of a 
Particular organism may be useful. Several excellent life his- 
tories are at hand which suggest that such prediction may be 
fruitful (e.g. Radin, 1926; Dyk, 1988, 1947; Shaw, 1930; 
Dollard, 1935). 

However useful individual studies may be for certain pur- 
Poses, it is clear that for reasons of both interest and neces- 
sity much social science activity is aimed at obtaining cor- 
relations between the (in some sense average) behavior of ag- 
gregates of individuals and specified stimulus conditions, or 


between some attributes of such aggregates and some other 


attributes of such aggregates. Generally speaking, this is 
likewise a considerable portion of the scientific activity in the 
area of S-R psychology- Whether other areas of study may 
expect assistance in this activity from S-R psychology turns 
in part upon the nature of the problem in question.” To this 


matter we now turn. f 
2. We will neglect many, sometimes important, contributions which S-R 
estigators in other fields. For example, an ex- 


sychol: an make to inv ‘ 
Tai Se, SR psychology» which, in part because of the possibility of 
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The criteria in terms of which individuals may be, and have 
been, aggregated into sets are numerous and depend on the 
kinds of problem the aggregator faces. Analysis consists in 
correlating some attributes of such a set with some other at- 
tributes of such a set, or some average behavior of such a set 
with some stimulus conditions, or some antecedent conditions 
pertaining to such a set with some behavior of such a set, and 
so forth. Whether stimulus-response theory can assist oF 
supplement such analyses depends mainly upon two things: 
1. whether elements in the analysis can be identified with ele- 
ments in the S-R formulation, and 2. whether, once this iden- 
tification is made, the empirical content of the S-R theoretical 
formulation is relevant to the problem at hand. Obviously, 
then, the hope of assistance from S-R theory depends greatly 
upon the particular problem at hand, and no over-all gen- 
eralization can be made on this count. 

A favorable instance is afforded by recent work (in terms 
of environment-inferred experience-based sets) of Whiting 
and Child (1953). They were interested in predicting typical 
explanations of illness in a number of societies, using COn- 
cepts from Hull and Freud. People holding such typical be- 
liefs in a given society were assumed to have been subjected 
as children to current socialization customs, defined as char- 
acteristic habits of a typical socializer in the society. A set 
was then formed on the basis of the severity or indulgence 
with which a given kind of socialization (e.g. weaning, toilet 
training, control of aggression) was presumed to have been 
administered. A set whose members were severely trained in 
regard to an item such as heterosexual play, for example; 


would include those individuals who presumably were pun- 


ished when and if they were found engaged in this kind of 


experimental control, emphasizes operat; 
and empirical testing of hypotheses, 
more careful about these matters wit 
which he is accustomed to using. As a 
the terminology employed in S-R ps: 
terms of which concepts can be expr 
standable to investigators in diverse 
they perhaps have more to do with the 
than with technical integration as such, 


k ional definitions of response events 
is apt to make an investigator much 
h respect to the data and techniques 
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activity. This kind of set is thus based on a presumption of 
ae specific experience. Using such sets as a basis for classi- 
ins Whiting and Child found significant correlations be- 
ween childhood experience and theories of illness. 

à This Was a favorable case because elements in the analyses 
(including aggregation criteria upon which set membership 
was based) were readily identifiable with theoretical elements 
in the systems of Hull and Freud. Further, the empirical 
content of these systems (that is, the phenomenal referents 
of the theoretical elements) was seemingly sufficient for the 
analysis in question. 

It must be expected, however, that many more cases will 
be unfavorable. This is sometimes because elements in the 
usual analysis cannot readily be identified with theoretical ele- 
ments in S-R psychology. (A good bit of our prior discussion 
has had a direct bearing upon this point. See, for example, 
our discussion of the difficulty of identifying reinforcers, 
Chap. 4, pp. 68 ff.) 

: Often, however, the reason 
in its present stage of deve 


for this is that S-R psychology, 
lopment, simply does not have 


the right kind of empirical data input to its theoretical formu- 
lations to permit their utilization, even if identification with 
the theoretical elements of the formulation seems possible. 
An example of this kind of situation may be found in eco- 
nomics, which is, by reason of the phenomena in which it is 
interested, about as favorable a general social science context 
for the possible application of S-R psychology as can be 
found. For one thing, behavior can often be measured in 
terms of quantities (e.g. goods bought or sold, hours worked, 
revenue expended, proportion of expenditure to income, 
which suggest a scaling of strength of tendency to perform. 
Furthermore, elements in an analysis of acquisition and/or 
disposition of material goods and services, and the like, can 
often be identified with antecedent conditions relating to 
drive, reward consequent upon performance, etc. Nevertheless 
the economist attempting to apply S-R psychology to par- 
ticular economic problems will usually find that (in addition 
to obstacles discussed earlier in this book) detailed applica- 
tion is precluded by the lack of empirical content relevant to 
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the problem at hand. For example, the analysis may strongly 
imply that the behavior in question is importantly dependent 
upon the drive status of the subject. But of what antecedent 
conditions may the drive status of the sub ject be said to be a 
function? From the point of view of empirical content, the 
Hullian formulation suggests a few possibilities, e.g. food 
and water deprivation, but rudimentary deprivation and 
“strong stimulus” conceptions of drive are seldom helpful in 
the analysis of the social economic behavior of subjects with 
long learning histories who are greatly influenced by sec- 
ondary motivations. 

Problems of theoretical formulation and of data input 
have been faced by workers who have attempted to apply 
Hullian analysis to complex social data. In general, the so- 
lution has been to utilize Hullian variables without specify- 
ing any rigorously defined set of operations by which these 
variables can be measured. For example, though the concept 
of drive is usually used, its presence and degree are identifie 
in various ways. j 

Gillin (1945) seeks to connect an acquired drive to pri- 
mary drive. “Among the Indians [in a Guatemalan com- 
munity] the money-drive is based closely upon innate drives 
of hunger and pain. An Indian wants money to buy food, 
shelter, and clothing, and to avoid the actual physical pun- 
ishment which is involved in failure to pay taxes, rents, WË ` 
other obligations.” In another set, the Ladinos, the money 


drive is acquired partly through the capacity of money tO 
bring prestige. 


Whiting (1941) is conce 
drive of pain, whose presenc 
tion of physical force. In ¢ 
Miller and Dollard’s (1941 
strong stimulus which imp 
quired drives, however, Whitin 
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used as an indication of amount of drive: “The fact that 
Kwoma children will mutilate their penises and willingly 
undergo scarification in order not to be classified as kara- 
ganda yikafa indicates the motivational power of this con- 
cept” (Whiting, 1941, p. 185). 

Another method is used by Dollard in his discussion of dif- 
fusion (Miller and Dollard, 1941, pp. 253-73), when he ap- 
parently infers the existence of acquired drives from the pres- 
ence of behavior which persistently results in the attainment 
of a given object. “Hunger is characteristic of all societies, 
but a secondary drive or appetite for acorns characterized 
the Indians of California, for the meat of the bison the 
Indians of the Great Plains, for salmon the dwellers of the 
northwest coast of America, etc.” (Miller and Dollard, 1941, 
P. 256.) Though the implication is clear that hunger is the 
primary drive on the basis of which these drives are acquired, 
their presence is inferred from behavior rather than from 
evidence of systematic conditioning. 

Schwartz (1954) discusses selection and training of his 
Populations as factors which would be expected to make pub- 
lic disapproval a greater “loss” to members of an Israeli 
collective than it would be to members of a comparable semi- 
Private village. This “expectation is confirmed,” according 
to the writer, by verbal responses to a Guttman scale indi- 
cating that adult members of the collective are more likely to 
follow public opinion in the event that it conflicts with their 
own inclinations. The relation between these test scores and 
training history as criteria for loss is, however, left indeter- 
minate, a resolution which is possible only where, as there, 
they converge. In the event of divergence between these two 
criteria, one should be explicitly accepted as defining the 


variable. 
All thes 
Phenomena alread. 
mately, prediction is 
to formulate theories 
havior, namely lexica 
been made by member: 
these will serve to pon 


e studies have been post hoe attempts to explain 
y known by their writers to exist. Ulti- 
the way of testing a theory. Attempts 
dealing with specific kinds of social be- 
l] innovation and social control, have 
s of our group. A brief discussion of 
t out some of the problems and pos- 
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sibilities facing those who would utilize Hullian theory for 
such purposes. . 

An example of an attempt to formulate an integrated 
theory of human social phenomena is the theory of lexical 
innovation. A lexeme occurrent in the idiolect of some mem- 
bers of a speech community but not others is a “test word.” 
A speaker who uses a test word is a “model.” A speaker who 
does not use the test word is a “tory.” When a tory adopts 
a test word from a model, lexical innovation is said to have 
taken place. Note that lexical innovation is not descriptive 
of the coinage of items but only of their spread from speaker 
to speaker. 


The factors postulated as important in lexical innovation 
are: 

1. The phonemic regularity of the test word (R,). 

2. The morphemic regularity of the test word (Rm). 

3. The status differential of model (x) over tory (y) 
(Ssys). 


4. The upward mobilit 


y of the tory (y) (M,). 
T The frequency of interaction between model and tory 
DA 


__ 6. The frequency of occurrence of the test word in the 
idiolect of the model in interaction with the tory (Fa). 
The likelihood (L) that a tory (y) will adopt the test 


word from a model (x) is stated, in terms of the above factors, 
tentatively as follows: 


L= (gR,) (eF,) (fF,) (DR, + cS,/, + dM,), 
where b, c, d, e, f, and & are empirical constants providing 
slack against misweighting the variables by arbitrary meas- 
uring devices.* = 

The techniques proposed f 
variables are drawn partl 
current sociological and a 


or obtaining values for the 
y from linguisties and partly from 
nthropological practice.® 

3. For a more detailed statement of the theory see Olmsted (1954b). 

4. We do not discuss here why some relationships of variables are pre- 
sented as multiplicative, others as additive, These are, at best, only hunches 
at present, and are more fully discussed in the work cited above. 

5. A research project designed to test the theor: 


d y is at present under 
way among the Achumawi of northeastern California, 
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Among the actual predictive theorems resulting from these 
Postulates are the following: 
wt oe factors being equal, a tory will adopt the pho- 
h cally more regular of two test words more rapidly than 
e an adopt the phonemically less regular one. 
ae Lies factors being equal, a tory will adopt a test word 
Nida led by a model x more rapidly than he will adopt one 

oa a model w if the status of x is higher than that of w. 
Pia Other factors being equal, tory y will adopt a test word 
a e rapidly than will tory z if the upward mobility of y is 
Sreater than that of z. 

i Other factors being equal, a tory will adopt the more 
we presented of two test words more rapidly than he 
ill adopt the less frequently presented one. 

The relation of these postulates to Hullian theory is at 
a twofold. First, their author has been influenced by 
ull’s use of deductive theory. This is a type of integrative 
i enefit which has been noted above. It should be pointed out, 
however, that this general method, though neatly exempli- 
fied by Hull, is sufficiently widespread so as not to co 
a distinctly Hullian contribution. 

Second, some variables and some r 

les have been suggested by Hullian th 
and Dollard’s (1941, 1950) discussion o 
lates on phonemic and morphemic regularity are suggested 
by the stimulus generalization concept; those having to do 
with status differential and upward mobility may presumably 
be related respectively to incentive and drive; and the final 
factors may be said to reflect opportunities for rewarded 


trials. 

It is significant, however, that the postulates of this theory 
have not themselves been formally deduced as theorems from 
Hull’s theory. The author has taken, as operations for de- 
fining and obtaining values for the variables, research tech- 
niques available in such disciplines as linguistics, sociology, 
and anthropology. It is by no means clear that these opera- 
tions will yield data which bear consistent and simple rela- 
tions to the Hullian variables. To assume such relations 
seemed quite unnecessary for purposes of this theory. 


nstitute 


elations between varia- 
neory and by Miller 
f it. Thus the postu- 
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An attempt to deduce a theory about social behavior from 
Hullian postulates reveals some of the difficulties entailed n 
such a process. One of the present writers has attempted to 
develop a theory of legal sanction in this manner.’ t 

Sanction is defined as interactive behavior which serves tO 
modify the drive level of the interactee. Sanction iR pont 
when it reduces drive, and negative when it increases it. Leen 
sanctions are those imposed by specialists acting 1n ti 
socially recognized and supported capacity as controllers z 
intragroup disturbance. Disturbance is any drive incre pa 
consequent upon a given behavior ; intensity of disturbance 
refers to the degree to which drive is increased, while per 
sity refers to the proportion of persons in the social group W?° 
experience some disturbance. . 

The rate of disturbing behavior is a decreasing funchon 
of the immediacy, frequency, and magnitude of (potent t 
disturbers’) drive reduction following behavior incompatib £ 
with the disturbing behavior. A decline in this rate can, E 
brought about directly by the administration of poste 
sanctions after such incompatible behavior. The likelihoo 
of such a decline can also be increased by the administration 
of negative sanctions following disturbing behavior, since 
the higher the drive created the greater will be the possible 
magnitude of drive reduction upon a switch to incompatible 
behavior. These sanctions tend to modify not only the be- 
havior of those who experience them directly but also of 
those who may be deterred through vicarious learning (see 
Chap. 6). Together with collateral (nonsanction) rewards 
and punishments they often have to offset the effect of sanc- 
tions for socially disturbing behavior which are provided by 
subgroups, as well as the effects of the reduction of phys10- 
logical and other drives for Which socially acceptable chan- 
nels have not been found. 

If single performances of given behavior effect a constant 
extensity and (mean) intensity of disturbance, then any 
decrease in the rate of performance will result in a decline 
in disturbance. Such a decline might be expected to rein- 
force those sanctions which preceded it as an increasing 

6. For a summary of the theory see Schwartz (1954). 
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function of the immediacy, frequency, and magnitude with 
which disturbance declines. Disturbance decline is, of course, 
only one of the consequences which can reinforce the per- 
formance of a given sanction. The likelihood that a given 
sanction will be employed against a given kind of behavior 
1s an increasing function of the degree to which such rein- 
forcements have occurred upon its previous employment 7 
and of the degree of similarity perceived by sanctioners be- 
tween the behavior previously subjected to control and the 
given behavior. Competing reactions (e.g. withdrawal with- 
out sanction) will, to the extent that they have been rein- 
forced, further diminish the likelihood of a given sanction 
being performed. 

This theory suggests several problems in the application 
of Hullian theory to social behavior: 

1. The Hullian definition of drive, in terms of hours of 
deprivation, seems unsatisfactory for the measure of most 
acquired drives. The drive concept, moreover, frequently bars 
Prediction of changes in the rate of disturbing acts by pre- 
dicting simultaneous decline in drive and reinforcement for 
nondisturbing acts. Until and unless these relations can be 
quantified, it would seem more fruitful to consider drive pri- 
marily in its bearing on reinforcement. 

_ 2. Human verbal processes force a reconsideration of Hul- 
lian definitions of time of delay of reinforcement and sim- 
ilarity of stimuli. Particularly important in this regard is 
the place of verbal norms. These appear to give cues to 
sanctionees which decrease anticipated reward for a given 
act. At the same time such cues serve to discriminate between 
sanctionable and nonsanctionable behavior, which under some 
conditions increases the possibility of a similar reaction by 
sanctioners. 

3. States of affairs which reinforce human responses are 
so variable (from person to person and for a given person 
through time) as to require new research techniques. Choice 


7. It is also deducible that such reactions will be relatively vigorous and 
have low latency. All of these measures will tend to contribute to a reduction 
of the disturbing behavior. It follows that reactions reinforced most strongly 
in the past will be employed in such a way as to be more likely to be re- 


inforced. 
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between states of affairs is proposed as the basis for an Ke 
tional definition of reinforcement, in preference to the “hi 
tory of the organism” method. dick 
4. Further problems arise from the attempt to edie” 
social action as a function of disturbance reduction. Pre ne 
tion is now attempted of the action of some iodividnali S 
are supported by others. Some index must be obtained o ae 
capacity of a given individual to support others, since = a 
individuals in a group have a greater power potential th 
others. . tite 
It would seem therefore that major innovations atea 
quired for an analysis of complex social behavior. One ea 
tinctively Hullian assumption is used, namely that the hs 
sponse measures are intercorrelated. This has pam eo 
the deduction given in note 7, Though our discussion of apa 
postulate suggests that it may not be universally ge 
(see Chap. 3), it would appear useful for the analysis 
much social behavior. With this exception, however, pe 
a few general notions, such as reinforcement and stimu = 
generalization, are retained. Neither of these concepts i 
uniquely Hullian, each being found in the earlier S-R theo 
ries of Thorndike and Pavlov. What has been used in ere 
as in the other works inspired by Hull, involves primarily 


these general notions. It is these which we consider the most 
useful parts of Hullian theory. 


CHAPTER 9 


SUMMARY 


discuss those issues which seemed to us crucial for ap- 
plication of stimulus-response psychology to cultural 
behavior. The observable variables of this psychological ap- 
proach are stimulus and antecedent conditions, including 
the immediate environment of an organism, the organism’s 
motivation, history of reinforcements, and responses. We 
have discussed techniques for operationally defining these 
variables in a general enough way so that they can be used 
in studying human social phenomena. We emphasized the 
advantages and problems arising from the observer’s use of 

his own natural language in making these definitions. 
dent conditions and responses, we 


After discussing antece 
made a preliminary attempt to deal with language and free 


behavior situations from an S-R point of view. We ap- 
proached problem-solving situations in terms of the inter- 
play between language and other variables in those situa- 
tions. This approach produced a tentative analysis of the 
relations between the structure and use of language and 
environmental variables in problem situations. Under the 
term “free behavior situations,” we suggested several models 
for analyzing behavior in cases where traditional independ- 
ent variables, like motivation, are not experimentally con- 
trolled. These models suggest that the distinction between 
independent and dependent variables, which psychology so 
often uses, may be expendable without loss of the ability 
to predict behavior quantitatively. Furthermore, these models 
suggest a fairly extensive research program. 

Finally, we also discussed problems involved in extending 
the particular S-R theory developed by Hull and his fol- 
lowers to cultural behavior. No single conclusion is dictated 
by our work as to the lkelibogd that Hullian theory will 


T the foregoing chapters we have tried to formulate and 


172 Behavior Theory and Social Science 


prove to be the most satisfactory basis for a general theory 
of human social behavior. Major divergences are to be 
found among the present authors on this score. One view 
holds that the Hullian theory as it now stands or as it may 
conceivably be modified probably cannot make any unique 
contribution to what is now known in social science and to 
what will be formulated in other theories. Another position 
holds that Hullian theory provides the best starting point 
for a general behavior science. We all agree that it provides 
at least a means of summarizing many of the empirical 
generalizations known to S-R psychology, and that these 
generalizations themselves provide a promising first step 
toward the integration of the social sciences. 


w 


G 


goa 


9 


x 


naea E eo Bf 


lara 
[z] 


GLOSSARY OF SYMBOLS 


A theoretical unit of “seeking or striving be- 
havior” in Free Behavior Model 2. 

Fixed interval schedule of reinforcement. 

Fixed ratio schedule of reinforcement. 

Drive, based on h; or rate of reinforcement. 

Motivation factor in Free Behavior Model 2. 


Same as sEr, En E2- .. for specific re- 
sponses. 

Same as sEr, En Be. - - for specific re- 
sponses. 

Same as sir, Ey, Ez- . - for specific re- 


sponses. 
Frequency of test word in idiolect of model. 
Frequency of interaction between model and 
tory. 
Associative factor in Free Behavior Model 2. 
Hours of deprivation. 
Same as sHr. 


Same as I,. 
Reactive inhibition, based on amount of work. 


Incentive motivation in Hull’s system, based 
on reinforcement. 

Likelihood of adoption of a test word. 

Magnitude of reinforcement. 

Mobility of y- 

Total number of reinforced responses. 

Total number of responses, reinforced or not. 

Rate of reinforced responses. 

Rate of responding. 


A subject. 
Preference, as in RPR: Ri preferred to Rz. 


Probability. 


Speed. 
Response; Ry, Re- -- specific responses. 


Specific responses made by individuals A and 
B in an interaction sequence. 
173 
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S*Ral, S*Rb2 


Szy 


Observable goal responses (eating, drinking, 
etc. ). 

Morphemic regularity of a test word (not a re- 
sponse). 

Phonemic regularity of test word (not a re- 
sponse). 

Theoretical response variable in Hull’s system, 
isomorphic with R. 

Theoretical goal response. 

Fractional part of Te- 

Theoretical perceptual response. 

Stimulus, S}, Sẹ . . . specific stimuli. 

Stimulus-response, as in stimulus-response 
theory or stimulus-response sequence. 

Drive stimuli. 

Stimuli provided one individual by the response 
of another in interaction. 

Status differential of model over tory. 

Stimulus trace, in Hull’s system. 

Excitatory potential, product of D, sHr, and 
K. 


Effective excitatory potential, 
sEr — (Ir + sIr). 
Response tendency, sEr — sOr. 


Habit strength, based on number of reinforced 
trials. 


Conditioned inhibition, 
nonreinforced trials. 
Suggested modification of K. 
Behavioral oscillation. 
Delay 
Time. 
Work, in Free Beh 
Weight of the goa 
Model in lexical in 
Tory in lexical jn 


based on number of 


of rein forcement. 


avior Model 3. 
l object. 
novation. 
novation. 


12. 


13. 


. Birge, J. S. (1941) Verbal 


. Bloch, B. (1948) A set of postulates 


. Bloch, B. (1950 
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